Nov 27 22:56:37 user nova-compute[75621]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75621) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 22:56:37 user nova-compute[75621]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75621) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 22:56:37 user nova-compute[75621]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75621) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 27 22:56:37 user nova-compute[75621]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 27 22:56:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 22:56:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 22:56:38 user nova-compute[75621]: INFO nova.virt.driver [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 27 22:56:38 user nova-compute[75621]: INFO nova.compute.provider_config [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Acquiring lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Acquired lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Releasing lock "singleton_lock" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Full set of CONF: {{(pid=75621) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ******************************************************************************** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Configuration options gathered from: {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ================================================================================ {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] allow_resize_to_same_host      = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] arq_binding_timeout            = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] backdoor_port                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] backdoor_socket                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] block_device_allocate_retries  = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] block_device_allocate_retries_interval = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cert                           = self.pem {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute_monitors               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] config_dir                     = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] config_drive_format            = iso9660 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] config_source                  = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] console_host                   = user {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] control_exchange               = nova {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cpu_allocation_ratio           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] daemon                         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] debug                          = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_access_ip_network_name = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_availability_zone      = nova {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_ephemeral_format       = ext4 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_green_pool_size        = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] default_schedule_zone          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] disk_allocation_ratio          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] enable_new_services            = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] enabled_ssl_apis               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] flat_injected                  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] force_config_drive             = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] force_raw_images               = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] graceful_shutdown_timeout      = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] heal_instance_info_cache_interval = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] host                           = user {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_build_timeout         = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_delete_interval       = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_name_template         = instance-%08x {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_usage_audit           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_usage_audit_period    = month {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] internal_service_availability_zone = internal {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] key                            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] live_migration_retry_count     = 30 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_config_append              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_dir                        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_file                       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_options                    = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_rotate_interval            = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_rotate_interval_type       = days {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] log_rotation_type              = none {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] long_rpc_timeout               = 1800 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_concurrent_builds          = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_concurrent_live_migrations = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_concurrent_snapshots       = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_local_block_devices        = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_logfile_count              = 30 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] max_logfile_size_mb            = 200 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] maximum_instance_delete_attempts = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metadata_listen                = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metadata_listen_port           = 8775 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metadata_workers               = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] migrate_max_retries            = -1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] mkisofs_cmd                    = genisoimage {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] my_ip                          = 10.0.0.210 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] network_allocate_retries       = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] osapi_compute_listen_port      = 8774 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] osapi_compute_unique_server_name_scope =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] osapi_compute_workers          = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] password_length                = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] periodic_enable                = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] periodic_fuzzy_delay           = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] pointer_model                  = ps2mouse {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] preallocate_images             = none {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] publish_errors                 = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] pybasedir                      = /opt/stack/nova {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ram_allocation_ratio           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rate_limit_burst               = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rate_limit_except_level        = CRITICAL {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rate_limit_interval            = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reboot_timeout                 = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reclaim_instance_interval      = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] record                         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reimage_timeout_per_gb         = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] report_interval                = 120 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rescue_timeout                 = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reserved_host_cpus             = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reserved_host_disk_mb          = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reserved_host_memory_mb        = 512 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] reserved_huge_pages            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] resize_confirm_window          = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] resize_fs_using_block_device   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] resume_guests_state_on_host_boot = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rpc_response_timeout           = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] run_external_periodic_tasks    = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] running_deleted_instance_action = reap {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] running_deleted_instance_timeout = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler_instance_sync_interval = 120 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_down_time              = 720 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] servicegroup_driver            = db {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] shelved_offload_time           = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] shelved_poll_interval          = 3600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] shutdown_timeout               = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] source_is_ipv6                 = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ssl_only                       = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] state_path                     = /opt/stack/data/nova {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] sync_power_state_interval      = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] sync_power_state_pool_size     = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] syslog_log_facility            = LOG_USER {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] tempdir                        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] timeout_nbd                    = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] transport_url                  = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] update_resources_interval      = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_cow_images                 = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_eventlog                   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_journal                    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_json                       = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_rootwrap_daemon            = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_stderr                     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] use_syslog                     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vcpu_pin_set                   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plugging_is_fatal          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plugging_timeout           = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] virt_mkfs                      = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] volume_usage_poll_interval     = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] watch_log_file                 = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] web                            = /usr/share/spice-html5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_concurrency.disable_process_locking = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.auth_strategy              = keystone {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.compute_link_prefix        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.dhcp_domain                = novalocal {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.enable_instance_password   = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.glance_link_prefix         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.instance_list_per_project_cells = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.list_records_by_skipping_down_cells = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.local_metadata_per_cell    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.max_limit                  = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.metadata_cache_expiration  = 15 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.neutron_default_tenant_id  = default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.use_forwarded_for          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.use_neutron_default_nets   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_dynamic_targets = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_jsonfile_path   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.backend_argument         = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.config_prefix            = cache.oslo {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.dead_timeout             = 60.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.debug_cache_backend      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.enable_retry_client      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.enable_socket_keepalive  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.enabled                  = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.expiration_time          = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.hashclient_retry_attempts = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_dead_retry      = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_password        =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_sasl_enabled    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.memcache_username        =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.proxies                  = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.retry_attempts           = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.retry_delay              = 0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.socket_keepalive_count   = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.socket_keepalive_idle    = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.socket_keepalive_interval = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.tls_allowed_ciphers      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.tls_cafile               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.tls_certfile             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.tls_enabled              = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cache.tls_keyfile              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.auth_section            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.auth_type               = password {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.cafile                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.certfile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.collect_timing          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.cross_az_attach         = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.debug                   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.endpoint_template       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.http_retries            = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.insecure                = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.keyfile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.os_region_name          = RegionOne {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.split_loggers           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cinder.timeout                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.cpu_dedicated_set      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.cpu_shared_set         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.image_type_exclude_list = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.resource_provider_association_refresh = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.shutdown_retry_interval = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] conductor.workers              = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] console.allowed_origins        = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] console.ssl_ciphers            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] console.ssl_minimum_version    = default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] consoleauth.token_ttl          = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.cafile                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.certfile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.collect_timing          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.connect_retries         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.connect_retry_delay     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.endpoint_override       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.insecure                = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.keyfile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.max_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.min_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.region_name             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.service_name            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.service_type            = accelerator {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.split_loggers           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.status_code_retries     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.timeout                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] cyborg.version                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.backend               = sqlalchemy {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.connection            = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.connection_debug      = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.connection_parameters =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.connection_recycle_time = 3600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.connection_trace      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.db_inc_retry_interval = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.db_max_retries        = 20 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.db_max_retry_interval = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.db_retry_interval     = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.max_overflow          = 50 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.max_pool_size         = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.max_retries           = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.mysql_wsrep_sync_wait = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.pool_timeout          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.retry_interval        = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.slave_connection      = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] database.sqlite_synchronous    = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.backend           = sqlalchemy {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.connection        = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.connection_debug  = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.connection_parameters =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.connection_recycle_time = 3600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.connection_trace  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.db_inc_retry_interval = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.db_max_retries    = 20 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.db_max_retry_interval = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.db_retry_interval = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.max_overflow      = 50 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.max_pool_size     = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.max_retries       = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.pool_timeout      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.retry_interval    = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.slave_connection  = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] api_database.sqlite_synchronous = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] devices.enabled_mdev_types     = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ephemeral_storage_encryption.enabled = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.api_servers             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.cafile                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.certfile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.collect_timing          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.connect_retries         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.connect_retry_delay     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.debug                   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.default_trusted_certificate_ids = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.enable_certificate_validation = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.enable_rbd_download     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.endpoint_override       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.insecure                = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.keyfile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.max_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.min_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.num_retries             = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.rbd_ceph_conf           =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.rbd_connect_timeout     = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.rbd_pool                =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.rbd_user                =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.region_name             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.service_name            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.service_type            = image {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.split_loggers           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.status_code_retries     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.timeout                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.verify_glance_signatures = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] glance.version                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] guestfs.debug                  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.config_drive_cdrom      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.config_drive_inject_password = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.enable_remotefx         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.instances_path_share    =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.limit_cpu_features      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.use_multipath_io        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.vswitch_name            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] mks.enabled                    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.manager_interval   = 2400 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.precache_concurrency = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.remove_unused_base_images = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] image_cache.subdirectory_name  = _base {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.api_max_retries         = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.api_retry_interval      = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.auth_section            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.auth_type               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.cafile                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.certfile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.collect_timing          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.conductor_group         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.connect_retries         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.connect_retry_delay     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.endpoint_override       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.insecure                = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.keyfile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.max_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.min_version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.peer_list               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.region_name             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.serial_console_state_timeout = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.service_name            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.service_type            = baremetal {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.split_loggers           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.status_code_retries     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.timeout                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ironic.version                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] key_manager.fixed_key          = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.barbican_api_version  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.barbican_endpoint     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.barbican_endpoint_type = public {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.barbican_region_name  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.cafile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.certfile              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.collect_timing        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.insecure              = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.keyfile               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.number_of_retries     = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.retry_delay           = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.send_service_user_token = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.split_loggers         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.timeout               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.verify_ssl            = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican.verify_ssl_path       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.auth_section = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.auth_type = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.cafile   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.certfile = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.collect_timing = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.insecure = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.keyfile  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.split_loggers = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] barbican_service_user.timeout  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.approle_role_id          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.approle_secret_id        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.cafile                   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.certfile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.collect_timing           = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.insecure                 = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.keyfile                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.kv_mountpoint            = secret {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.kv_path                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.kv_version               = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.namespace                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.root_token_id            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.split_loggers            = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.ssl_ca_crt_file          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.timeout                  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.use_ssl                  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.auth_section          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.auth_type             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.cafile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.certfile              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.collect_timing        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.connect_retries       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.connect_retry_delay   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.endpoint_override     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.insecure              = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.keyfile               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.max_version           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.min_version           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.region_name           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.service_name          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.service_type          = identity {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.split_loggers         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.status_code_retries   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.timeout               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] keystone.version               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.connection_uri         =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_mode               = custom {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: WARNING oslo_config.cfg [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_power_governor_high = performance {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_power_management   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.device_detach_attempts = 8 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.device_detach_timeout  = 20 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.disk_cachemodes        = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.disk_prefix            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.enabled_perf_events    = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.file_backed_memory     = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.gid_maps               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.hw_disk_discard        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.hw_machine_type        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_rbd_pool        = rbd {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_type            = default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.images_volume_group    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.inject_key             = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.inject_partition       = -2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.inject_password        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.iscsi_iface            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.iser_use_multipath     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_downtime = 500 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_inbound_addr = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_scheme  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_timeout_action = abort {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_tunnelled = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: WARNING oslo_config.cfg [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 27 22:56:38 user nova-compute[75621]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 27 22:56:38 user nova-compute[75621]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 27 22:56:38 user nova-compute[75621]: and ``live_migration_inbound_addr`` respectively.
Nov 27 22:56:38 user nova-compute[75621]: ).  Its value may be silently ignored in the future.
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.live_migration_with_native_tls = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.max_queues             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.nfs_mount_options      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_pcie_ports         = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.pmem_namespaces        = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.quobyte_client_cfg     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rbd_secret_uuid        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rbd_user               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rescue_image_id        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rescue_kernel_id       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.rx_queue_size          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.smbfs_mount_options    =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.snapshot_compression   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.snapshot_image_format  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.sparse_logical_volumes = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.swtpm_enabled          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.swtpm_group            = tss {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.swtpm_user             = tss {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.sysinfo_serial         = unique {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.tb_cache_size          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.tx_queue_size          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.uid_maps               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.use_virtio_for_bridges = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.virt_type              = kvm {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.volume_clear           = zero {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.volume_clear_size      = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.volume_use_multipath   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_cache_path   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.auth_section           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.auth_type              = password {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.cafile                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.certfile               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.collect_timing         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.connect_retries        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.connect_retry_delay    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.default_floating_pool  = public {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.endpoint_override      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.extension_sync_interval = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.http_retries           = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.insecure               = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.keyfile                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.max_version            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.min_version            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.ovs_bridge             = br-int {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.physnets               = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.region_name            = RegionOne {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.service_metadata_proxy = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.service_name           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.service_type           = network {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.split_loggers          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.status_code_retries    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.timeout                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] neutron.version                = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] notifications.bdms_in_notifications = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] notifications.default_level    = INFO {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] notifications.notification_format = unversioned {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] notifications.notify_on_state_change = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] pci.alias                      = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] pci.device_spec                = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] pci.report_in_placement        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.auth_section         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.auth_type            = password {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.cafile               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.certfile             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.collect_timing       = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.connect_retries      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.connect_retry_delay  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.default_domain_id    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.default_domain_name  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.domain_id            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.domain_name          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.endpoint_override    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.insecure             = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.keyfile              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.max_version          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.min_version          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.password             = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.project_domain_id    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.project_domain_name  = Default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.project_id           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.project_name         = service {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.region_name          = RegionOne {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.service_name         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.service_type         = placement {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.split_loggers        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.status_code_retries  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.system_scope         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.timeout              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.trust_id             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.user_domain_id       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.user_domain_name     = Default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.user_id              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.username             = placement {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] placement.version              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.cores                    = 20 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.count_usage_from_placement = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.injected_file_content_bytes = 10240 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.injected_file_path_length = 255 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.injected_files           = 5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.instances                = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.key_pairs                = 100 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.metadata_items           = 128 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.ram                      = 51200 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.recheck_quota            = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.server_group_members     = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] quota.server_groups            = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rdp.enabled                    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.image_metadata_prefilter = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.max_attempts         = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.max_placement_results = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] scheduler.workers              = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.host_subset_size = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.isolated_hosts = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.isolated_images = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.pci_in_placement = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.track_instance_changes = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metrics.required               = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metrics.weight_multiplier      = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] metrics.weight_setting         = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.enabled         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.port_range      = 10000:20000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] serial_console.serialproxy_port = 6083 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.auth_section      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.auth_type         = password {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.cafile            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.certfile          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.collect_timing    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.insecure          = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.keyfile           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.send_service_user_token = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.split_loggers     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] service_user.timeout           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.agent_enabled            = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.enabled                  = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.html5proxy_port          = 6082 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.image_compression        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.jpeg_compression         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.playback_compression     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.server_listen            = 127.0.0.1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.streaming_mode           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] spice.zlib_compression         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] upgrade_levels.baseapi         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] upgrade_levels.compute         = auto {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] upgrade_levels.conductor       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] upgrade_levels.scheduler       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.cafile = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.certfile = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.insecure = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vendordata_dynamic_auth.timeout = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.api_retry_count         = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.ca_file                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.cache_prefix            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.cluster_name            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.connection_pool_size    = 10 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.console_delay_seconds   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.datastore_regex         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.host_ip                 = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.host_password           = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.host_port               = 443 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.host_username           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.insecure                = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.integration_bridge      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.maximum_objects         = 100 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.pbm_default_policy      = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.pbm_enabled             = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.pbm_wsdl_location       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.serial_port_proxy_uri   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.serial_port_service_uri = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.task_poll_interval      = 0.5 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.use_linked_clone        = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.vnc_keymap              = en-us {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.vnc_port                = 5900 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vmware.vnc_port_total          = 10000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.auth_schemes               = ['none'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.enabled                    = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.novncproxy_port            = 6080 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.vencrypt_ca_certs          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.vencrypt_client_cert       = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vnc.vencrypt_client_key        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.disable_rootwrap   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.enable_numa_live_migration = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.libvirt_disable_apic = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.client_socket_timeout     = 900 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.default_pool_size         = 1000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.keep_alive                = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.max_header_line           = 16384 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.ssl_ca_file               = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.ssl_cert_file             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.ssl_key_file              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.tcp_keepidle              = 600 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] zvm.ca_file                    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] zvm.cloud_connector_url        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] zvm.reachable_timeout          = 300 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.enforce_new_defaults = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.enforce_scope      = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.policy_default_rule = default {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.connection_string     = messaging:// {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.enabled               = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.es_doc_type           = notification {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.es_scroll_size        = 10000 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.es_scroll_time        = 2m {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.filter_error_trace    = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.hmac_keys             = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.sentinel_service_name = mymaster {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.socket_timeout        = 0.1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.trace_requests        = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler.trace_sqlalchemy      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler_jaeger.process_tags   = {} {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler_jaeger.service_name_prefix = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] profiler_otlp.service_name_prefix = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] remote_debug.host              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] remote_debug.port              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_notifications.retry = -1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.auth_section        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.auth_type           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.cafile              = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.certfile            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.collect_timing      = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.connect_retries     = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.connect_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.endpoint_id         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.endpoint_override   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.insecure            = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.keyfile             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.max_version         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.min_version         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.region_name         = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.service_name        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.service_type        = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.split_loggers       = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.status_code_retries = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.status_code_retry_delay = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.timeout             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.valid_interfaces    = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_limit.version             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_reports.file_event_handler = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] oslo_reports.log_dir           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.group  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] vif_plug_ovs_privileged.user   = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.isolate_vif         = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] os_brick.lock_path             = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.capabilities   = [21] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.group          = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.helper_command = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] privsep_osbrick.user           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.group           = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.helper_command  = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] nova_sys_admin.user            = None {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG oslo_service.service [None req-4d64de21-00de-4364-91de-f8727a97e897 None None] ******************************************************************************** {{(pid=75621) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 27 22:56:38 user nova-compute[75621]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Connecting to libvirt: qemu:///system {{(pid=75621) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f130114a410> {{(pid=75621) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Nov 27 22:56:38 user nova-compute[75621]: libvirt:  error : internal error: could not initialize domain event timer
Nov 27 22:56:38 user nova-compute[75621]: WARNING nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f130114a410> {{(pid=75621) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Starting native event thread {{(pid=75621) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Starting green dispatch thread {{(pid=75621) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Starting connection event dispatch thread {{(pid=75621) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Nov 27 22:56:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Connection event '1' reason 'None'
Nov 27 22:56:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 22:56:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.mount [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Initialising _HostMountState generation 0 {{(pid=75621) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 27 22:56:45 user nova-compute[75621]: INFO nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host capabilities <capabilities>
Nov 27 22:56:45 user nova-compute[75621]:   <host>
Nov 27 22:56:45 user nova-compute[75621]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 27 22:56:45 user nova-compute[75621]:     <cpu>
Nov 27 22:56:45 user nova-compute[75621]:       <arch>x86_64</arch>
Nov 27 22:56:45 user nova-compute[75621]:       <model>IvyBridge-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:45 user nova-compute[75621]:       <microcode version='1070'/>
Nov 27 22:56:45 user nova-compute[75621]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 27 22:56:45 user nova-compute[75621]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='ss'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='vmx'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='pcid'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='osxsave'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='hypervisor'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='arat'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='tsc_adjust'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='md-clear'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='stibp'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='arch-capabilities'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='ssbd'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='invtsc'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='rsba'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature name='skip-l1dfl-vmentry'/>
Nov 27 22:56:45 user nova-compute[75621]:       <pages unit='KiB' size='4'/>
Nov 27 22:56:45 user nova-compute[75621]:       <pages unit='KiB' size='2048'/>
Nov 27 22:56:45 user nova-compute[75621]:     </cpu>
Nov 27 22:56:45 user nova-compute[75621]:     <power_management>
Nov 27 22:56:45 user nova-compute[75621]:       <suspend_mem/>
Nov 27 22:56:45 user nova-compute[75621]:       <suspend_disk/>
Nov 27 22:56:45 user nova-compute[75621]:       <suspend_hybrid/>
Nov 27 22:56:45 user nova-compute[75621]:     </power_management>
Nov 27 22:56:45 user nova-compute[75621]:     <iommu support='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     <migration_features>
Nov 27 22:56:45 user nova-compute[75621]:       <live/>
Nov 27 22:56:45 user nova-compute[75621]:       <uri_transports>
Nov 27 22:56:45 user nova-compute[75621]:         <uri_transport>tcp</uri_transport>
Nov 27 22:56:45 user nova-compute[75621]:         <uri_transport>rdma</uri_transport>
Nov 27 22:56:45 user nova-compute[75621]:       </uri_transports>
Nov 27 22:56:45 user nova-compute[75621]:     </migration_features>
Nov 27 22:56:45 user nova-compute[75621]:     <topology>
Nov 27 22:56:45 user nova-compute[75621]:       <cells num='2'>
Nov 27 22:56:45 user nova-compute[75621]:         <cell id='0'>
Nov 27 22:56:45 user nova-compute[75621]:           <memory unit='KiB'>8140616</memory>
Nov 27 22:56:45 user nova-compute[75621]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 27 22:56:45 user nova-compute[75621]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 22:56:45 user nova-compute[75621]:           <distances>
Nov 27 22:56:45 user nova-compute[75621]:             <sibling id='0' value='10'/>
Nov 27 22:56:45 user nova-compute[75621]:             <sibling id='1' value='20'/>
Nov 27 22:56:45 user nova-compute[75621]:           </distances>
Nov 27 22:56:45 user nova-compute[75621]:           <cpus num='6'>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 27 22:56:45 user nova-compute[75621]:           </cpus>
Nov 27 22:56:45 user nova-compute[75621]:         </cell>
Nov 27 22:56:45 user nova-compute[75621]:         <cell id='1'>
Nov 27 22:56:45 user nova-compute[75621]:           <memory unit='KiB'>8255100</memory>
Nov 27 22:56:45 user nova-compute[75621]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 27 22:56:45 user nova-compute[75621]:           <pages unit='KiB' size='2048'>0</pages>
Nov 27 22:56:45 user nova-compute[75621]:           <distances>
Nov 27 22:56:45 user nova-compute[75621]:             <sibling id='0' value='20'/>
Nov 27 22:56:45 user nova-compute[75621]:             <sibling id='1' value='10'/>
Nov 27 22:56:45 user nova-compute[75621]:           </distances>
Nov 27 22:56:45 user nova-compute[75621]:           <cpus num='6'>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 27 22:56:45 user nova-compute[75621]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 27 22:56:45 user nova-compute[75621]:           </cpus>
Nov 27 22:56:45 user nova-compute[75621]:         </cell>
Nov 27 22:56:45 user nova-compute[75621]:       </cells>
Nov 27 22:56:45 user nova-compute[75621]:     </topology>
Nov 27 22:56:45 user nova-compute[75621]:     <cache>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 27 22:56:45 user nova-compute[75621]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 27 22:56:45 user nova-compute[75621]:     </cache>
Nov 27 22:56:45 user nova-compute[75621]:     <secmodel>
Nov 27 22:56:45 user nova-compute[75621]:       <model>apparmor</model>
Nov 27 22:56:45 user nova-compute[75621]:       <doi>0</doi>
Nov 27 22:56:45 user nova-compute[75621]:     </secmodel>
Nov 27 22:56:45 user nova-compute[75621]:     <secmodel>
Nov 27 22:56:45 user nova-compute[75621]:       <model>dac</model>
Nov 27 22:56:45 user nova-compute[75621]:       <doi>0</doi>
Nov 27 22:56:45 user nova-compute[75621]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 27 22:56:45 user nova-compute[75621]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 27 22:56:45 user nova-compute[75621]:     </secmodel>
Nov 27 22:56:45 user nova-compute[75621]:   </host>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='alpha'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>clipper</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='armv6l'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>spitz</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>nuri</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>kzm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>z2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>tosa</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n810</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>terrier</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>midway</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>microbit</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>verdex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>highbank</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>akita</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>connex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>collie</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='armv7l'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>spitz</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>nuri</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>kzm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>z2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>tosa</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n810</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>terrier</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>midway</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>microbit</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>verdex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>highbank</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>akita</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>connex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>collie</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='aarch64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>integratorcp</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>borzoi</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>spitz</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>nuri</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-b1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatileab</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>kzm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>musca-a</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>smdkc210</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>z2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>tosa</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>sabrelite</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-eb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n810</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>n800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>versatilepb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>terrier</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mainstone</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>midway</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>musicpal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>microbit</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cubieboard</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>verdex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduino2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>raspi3b</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>raspi2b</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>cheetah</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>highbank</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>akita</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>connex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>collie</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>raspi0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <acpi default='on' toggle='yes'/>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='cris'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='i686'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>isapc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>microvm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='kvm'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <pae/>
Nov 27 22:56:45 user nova-compute[75621]:       <nonpae/>
Nov 27 22:56:45 user nova-compute[75621]:       <acpi default='on' toggle='yes'/>
Nov 27 22:56:45 user nova-compute[75621]:       <apic default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='m68k'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>an5206</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>q800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>next-cube</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='microblaze'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='microblazeel'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='mips'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>malta</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='mipsel'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>malta</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='mips64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>malta</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>pica61</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>magnum</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='mips64el'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>malta</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mipssim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>pica61</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>magnum</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='16'>boston</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='ppc'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mac99</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>40p</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>taihu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='ppc64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>taihu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>40p</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mac99</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='ppc64le'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>taihu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ppce500</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>40p</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>pegasos2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>bamboo</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>g3beige</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>mac99</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sam460ex</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>ref405ep</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2048'>powernv8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='riscv32'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='8'>spike</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>opentitan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='8'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='riscv64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='8'>spike</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='5'>sifive_u</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>shakti_c</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sifive_e</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='8'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='s390x'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='sh4'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>shix</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>r2d</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='sh4eb'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>shix</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>r2d</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='sparc'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>SS-5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>SS-20</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>LX</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>SS-4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>SS-10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>Voyager</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='sparc64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sun4u</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>niagara</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>sun4v</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='x86_64'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>64</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>x-remote</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='1'>isapc</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>microvm</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='kvm'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <acpi default='on' toggle='yes'/>
Nov 27 22:56:45 user nova-compute[75621]:       <apic default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='xtensa'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>sim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>kc705</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ml605</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx200</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx60</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]:   <guest>
Nov 27 22:56:45 user nova-compute[75621]:     <os_type>hvm</os_type>
Nov 27 22:56:45 user nova-compute[75621]:     <arch name='xtensaeb'>
Nov 27 22:56:45 user nova-compute[75621]:       <wordsize>32</wordsize>
Nov 27 22:56:45 user nova-compute[75621]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='4'>sim</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>kc705</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ml605</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>virt</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx200</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>lx60</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 27 22:56:45 user nova-compute[75621]:       <domain type='qemu'/>
Nov 27 22:56:45 user nova-compute[75621]:     </arch>
Nov 27 22:56:45 user nova-compute[75621]:     <features>
Nov 27 22:56:45 user nova-compute[75621]:       <cpuselection/>
Nov 27 22:56:45 user nova-compute[75621]:       <deviceboot/>
Nov 27 22:56:45 user nova-compute[75621]:       <disksnapshot default='on' toggle='no'/>
Nov 27 22:56:45 user nova-compute[75621]:     </features>
Nov 27 22:56:45 user nova-compute[75621]:   </guest>
Nov 27 22:56:45 user nova-compute[75621]: </capabilities>
Nov 27 22:56:45 user nova-compute[75621]: 
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 27 22:56:45 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:45 user nova-compute[75621]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 22:56:45 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:45 user nova-compute[75621]:   <machine>pc-q35-6.2</machine>
Nov 27 22:56:45 user nova-compute[75621]:   <arch>i686</arch>
Nov 27 22:56:45 user nova-compute[75621]:   <vcpu max='288'/>
Nov 27 22:56:45 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:45 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:     <enum name='firmware'/>
Nov 27 22:56:45 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:     </loader>
Nov 27 22:56:45 user nova-compute[75621]:   </os>
Nov 27 22:56:45 user nova-compute[75621]:   <cpu>
Nov 27 22:56:45 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:     </mode>
Nov 27 22:56:45 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:     </mode>
Nov 27 22:56:45 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:45 user nova-compute[75621]:       <feature policy='disable' name='lm'/>
Nov 27 22:56:45 user nova-compute[75621]:     </mode>
Nov 27 22:56:45 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>kvm64</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>core2duo</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Westmere</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Penryn</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Opteron_G1</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Nehalem</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Conroe</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:45 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:45 user nova-compute[75621]:     </mode>
Nov 27 22:56:45 user nova-compute[75621]:   </cpu>
Nov 27 22:56:45 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:45 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:45 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:45 user nova-compute[75621]:     </enum>
Nov 27 22:56:45 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:45 user nova-compute[75621]:   <devices>
Nov 27 22:56:45 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:45 user nova-compute[75621]:       </enum>
Nov 27 22:56:45 user nova-compute[75621]:     </disk>
Nov 27 22:56:45 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:45 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:45 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:45 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-q35-jammy</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>i686</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='288'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'/>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='lm'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-i440fx-jammy</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>i686</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='255'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'/>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='lm'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ide</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-i386</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-i440fx-6.2</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>i686</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='255'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'/>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='lm'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ide</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'ubuntu', 'pc'} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-q35-6.2</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>x86_64</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='288'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>efi</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='invtsc'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='rsba'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-q35-jammy</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>x86_64</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='288'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>efi</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='invtsc'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='rsba'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-i440fx-jammy</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>x86_64</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='255'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>efi</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='invtsc'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='rsba'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ide</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 27 22:56:46 user nova-compute[75621]: <domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 27 22:56:46 user nova-compute[75621]:   <domain>kvm</domain>
Nov 27 22:56:46 user nova-compute[75621]:   <machine>pc-i440fx-6.2</machine>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>x86_64</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <vcpu max='255'/>
Nov 27 22:56:46 user nova-compute[75621]:   <iothreads supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:   <os supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='firmware'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>efi</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:     <loader supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>rom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pflash</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='readonly'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>yes</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='secure'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>no</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </loader>
Nov 27 22:56:46 user nova-compute[75621]:   </os>
Nov 27 22:56:46 user nova-compute[75621]:   <cpu>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-passthrough' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='hostPassthroughMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='maximum' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='maximumMigratable'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>on</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>off</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='host-model' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ss'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='vmx'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pcid'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='hypervisor'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arat'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='tsc_adjust'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='umip'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='md-clear'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='arch-capabilities'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='invtsc'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibpb'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='ibrs'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-stibp'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='amd-ssbd'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='rsba'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='require' name='pschange-mc-no'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='erms'/>
Nov 27 22:56:46 user nova-compute[75621]:       <feature policy='disable' name='xsaveopt'/>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:     <mode name='custom' supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>qemu64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>qemu32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>phenom</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>pentium</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>n270</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm64</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>kvm32</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>coreduo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>core2duo</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>athlon</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Westmere</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Snowridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Skylake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>SandyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Penryn</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G5</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G4</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G3</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Opteron_G2</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Opteron_G1</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>IvyBridge</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Icelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Haswell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Rome</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-Milan</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC-IBPB</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>EPYC</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Dhyana</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cooperlake</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>Conroe</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Cascadelake-Server</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-noTSX</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell-IBRS</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='no'>Broadwell</model>
Nov 27 22:56:46 user nova-compute[75621]:       <model usable='yes'>486</model>
Nov 27 22:56:46 user nova-compute[75621]:     </mode>
Nov 27 22:56:46 user nova-compute[75621]:   </cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <memoryBacking supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:     <enum name='sourceType'>
Nov 27 22:56:46 user nova-compute[75621]:       <value>file</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>anonymous</value>
Nov 27 22:56:46 user nova-compute[75621]:       <value>memfd</value>
Nov 27 22:56:46 user nova-compute[75621]:     </enum>
Nov 27 22:56:46 user nova-compute[75621]:   </memoryBacking>
Nov 27 22:56:46 user nova-compute[75621]:   <devices>
Nov 27 22:56:46 user nova-compute[75621]:     <disk supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='diskDevice'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>disk</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cdrom</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>floppy</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>lun</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='bus'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ide</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>fdc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sata</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </disk>
Nov 27 22:56:46 user nova-compute[75621]:     <graphics supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='type'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>sdl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vnc</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>spice</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egl-headless</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </graphics>
Nov 27 22:56:46 user nova-compute[75621]:     <video supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='modelType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>cirrus</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>vmvga</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>qxl</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>none</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>bochs</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>ramfb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </video>
Nov 27 22:56:46 user nova-compute[75621]:     <hostdev supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='mode'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>subsystem</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='startupPolicy'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>default</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>mandatory</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>requisite</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>optional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='subsysType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>usb</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>pci</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>scsi</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='capsType'/>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='pciBackend'/>
Nov 27 22:56:46 user nova-compute[75621]:     </hostdev>
Nov 27 22:56:46 user nova-compute[75621]:     <rng supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtio-non-transitional</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>random</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>egd</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>builtin</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </rng>
Nov 27 22:56:46 user nova-compute[75621]:     <filesystem supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='driverType'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>path</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>handle</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>virtiofs</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </filesystem>
Nov 27 22:56:46 user nova-compute[75621]:     <tpm supported='yes'>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='model'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-tis</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>tpm-crb</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:       <enum name='backendModel'>
Nov 27 22:56:46 user nova-compute[75621]:         <value>passthrough</value>
Nov 27 22:56:46 user nova-compute[75621]:         <value>emulator</value>
Nov 27 22:56:46 user nova-compute[75621]:       </enum>
Nov 27 22:56:46 user nova-compute[75621]:     </tpm>
Nov 27 22:56:46 user nova-compute[75621]:   </devices>
Nov 27 22:56:46 user nova-compute[75621]:   <features>
Nov 27 22:56:46 user nova-compute[75621]:     <gic supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:     <vmcoreinfo supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <genid supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backingStoreInput supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <backup supported='yes'/>
Nov 27 22:56:46 user nova-compute[75621]:     <sev supported='no'/>
Nov 27 22:56:46 user nova-compute[75621]:   </features>
Nov 27 22:56:46 user nova-compute[75621]: </domainCapabilities>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75621) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75621) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Checking secure boot support for host arch (x86_64) {{(pid=75621) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Secure Boot support detected
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] cpu compare xml: <cpu match="exact">
Nov 27 22:56:46 user nova-compute[75621]:   <model>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]: </cpu>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10020}}
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.virt.node [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Generated node identity 6c22fa5b-3db0-4974-9b71-20fe6f488e9f
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.virt.node [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Wrote node identity 6c22fa5b-3db0-4974-9b71-20fe6f488e9f to /opt/stack/data/nova/compute_id
Nov 27 22:56:46 user nova-compute[75621]: WARNING nova.compute.manager [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Compute nodes ['6c22fa5b-3db0-4974-9b71-20fe6f488e9f'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.compute.manager [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 27 22:56:46 user nova-compute[75621]: WARNING nova.compute.manager [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 27 22:56:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 22:56:46 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:56:46 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Hypervisor/Node resource view: name=user free_ram=10994MB free_disk=26.072402954101562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:56:46 user nova-compute[75621]: WARNING nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] No compute node record for user:6c22fa5b-3db0-4974-9b71-20fe6f488e9f: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 6c22fa5b-3db0-4974-9b71-20fe6f488e9f could not be found.
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Compute node record created for user:user with uuid: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] [req-72cfa88a-2b8f-4125-abe3-71c8328a4a7c] Created resource provider record via placement API for resource provider with UUID 6c22fa5b-3db0-4974-9b71-20fe6f488e9f and name user.
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75621) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Nov 27 22:56:46 user nova-compute[75621]: INFO nova.virt.libvirt.host [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] kernel doesn't support AMD SEV
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Libvirt baseline CPU <cpu>
Nov 27 22:56:46 user nova-compute[75621]:   <arch>x86_64</arch>
Nov 27 22:56:46 user nova-compute[75621]:   <model>Nehalem</model>
Nov 27 22:56:46 user nova-compute[75621]:   <vendor>Intel</vendor>
Nov 27 22:56:46 user nova-compute[75621]:   <topology sockets="6" cores="1" threads="1"/>
Nov 27 22:56:46 user nova-compute[75621]: </cpu>
Nov 27 22:56:46 user nova-compute[75621]:  {{(pid=75621) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12510}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Updated inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Updating resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f generation from 0 to 1 during operation: update_inventory {{(pid=75621) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 22:56:46 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Updating resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f generation from 1 to 2 during operation: update_traits {{(pid=75621) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG nova.service [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Creating RPC server for service compute {{(pid=75621) start /opt/stack/nova/nova/service.py:182}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG nova.service [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] Join ServiceGroup membership for this service compute {{(pid=75621) start /opt/stack/nova/nova/service.py:199}}
Nov 27 22:56:47 user nova-compute[75621]: DEBUG nova.servicegroup.drivers.db [None req-4a671690-c0d9-4ebb-9cd7-1778404dadd1 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75621) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 27 22:57:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 22:57:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 22:57:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:57:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=10438MB free_disk=25.976078033447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 22:57:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 22:58:40 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:58:40 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=10352MB free_disk=26.040416717529297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 22:58:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:59:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 22:59:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 22:59:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:59:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=10316MB free_disk=25.792747497558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 22:59:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.101s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:00:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:00:42 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:00:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9653MB free_disk=25.812591552734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:00:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:00:47 user nova-compute[75621]: INFO nova.compute.claims [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Claim successful on node user
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:00:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:00:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:00:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:00:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Creating image(s)
Nov 27 23:00:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "/opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "/opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:48 user nova-compute[75621]: DEBUG nova.policy [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d1fa967559449abaf467360c3e33e86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56e5376240c4933a75d2962d3ea0d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG nova.virt.images [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] 6631148d-0ff5-48f2-bd92-4bf6df1a42c4 was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.part /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.part /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.converted" returned: 0 in 0.288s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.684s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:49 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpuewowb4e/privsep.sock']
Nov 27 23:00:49 user sudo[84861]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpuewowb4e/privsep.sock
Nov 27 23:00:49 user sudo[84861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 23:00:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Successfully created port: 4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:00:51 user sudo[84861]: pam_unix(sudo:session): session closed for user root
Nov 27 23:00:51 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Spawned new privsep daemon via rootwrap
Nov 27 23:00:51 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 23:00:51 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 23:00:51 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 27 23:00:51 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84869
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:00:51 user nova-compute[75621]: INFO nova.compute.claims [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Claim successful on node user
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.159s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk 1073741824" returned: 0 in 0.054s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:51 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Cannot resize image /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Ensure instance console log exists: /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:00:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Creating image(s)
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.policy [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f116260296b94e55916e029d103f2126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '776ddd88f0e543769f6e275217231ecd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:00:52 user nova-compute[75621]: INFO nova.compute.claims [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Claim successful on node user
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk 1073741824" returned: 0 in 0.054s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:00:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Cannot resize image /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Ensure instance console log exists: /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:00:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.policy [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506743bc2ab54538b400595de8792b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef81acb6ed764a23a83269df20981c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:00:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Creating image(s)
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "/opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:00:53 user nova-compute[75621]: INFO nova.compute.claims [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Claim successful on node user
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk 1073741824" returned: 0 in 0.080s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Successfully created port: 057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Successfully updated port: 4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquired lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:00:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Cannot resize image /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Ensure instance console log exists: /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:00:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Creating image(s)
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-changed-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Refreshing instance network info cache due to event network-changed-4182e86e-d05e-4f90-bef4-bf7979644e49. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] Acquiring lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:00:54 user nova-compute[75621]: INFO nova.compute.claims [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Claim successful on node user
Nov 27 23:00:54 user nova-compute[75621]: DEBUG nova.policy [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc5cf604fbfd4f1dbdbe80b05f540425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea584e6a3e6b441d8fdec3f91a1c23ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Successfully created port: 37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Cannot resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Ensure instance console log exists: /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updating instance_info_cache with network_info: [{"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Releasing lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Instance network_info: |[{"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] Acquired lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Refreshing network info cache for port 4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Start _get_guest_xml network_info=[{"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Successfully updated port: 057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:00:55 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:55 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1706753872',display_name='tempest-DeleteServersTestJSON-server-1706753872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1706753872',id=1,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56e5376240c4933a75d2962d3ea0d8f',ramdisk_id='',reservation_id='r-6jiyrs20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-495956292',owner_user_name='tempest-DeleteServersTestJSON-495956292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:48Z,user_data=None,user_id='5d1fa967559449abaf467360c3e33e86',uuid=7d493459-5f13-4636-af59-35825af940e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converting VIF {"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d493459-5f13-4636-af59-35825af940e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:00:55 user nova-compute[75621]:   <uuid>7d493459-5f13-4636-af59-35825af940e9</uuid>
Nov 27 23:00:55 user nova-compute[75621]:   <name>instance-00000001</name>
Nov 27 23:00:55 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:00:55 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:00:55 user nova-compute[75621]:   <metadata>
Nov 27 23:00:55 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:00:55 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:name>tempest-DeleteServersTestJSON-server-1706753872</nova:name>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:00:55</nova:creationTime>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:00:55 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:00:55 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:owner>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:user uuid="5d1fa967559449abaf467360c3e33e86">tempest-DeleteServersTestJSON-495956292-project-member</nova:user>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:project uuid="c56e5376240c4933a75d2962d3ea0d8f">tempest-DeleteServersTestJSON-495956292</nova:project>
Nov 27 23:00:55 user nova-compute[75621]:       </nova:owner>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:00:55 user nova-compute[75621]:       <nova:ports>
Nov 27 23:00:55 user nova-compute[75621]:         <nova:port uuid="4182e86e-d05e-4f90-bef4-bf7979644e49">
Nov 27 23:00:55 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 23:00:55 user nova-compute[75621]:         </nova:port>
Nov 27 23:00:55 user nova-compute[75621]:       </nova:ports>
Nov 27 23:00:55 user nova-compute[75621]:     </nova:instance>
Nov 27 23:00:55 user nova-compute[75621]:   </metadata>
Nov 27 23:00:55 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:00:55 user nova-compute[75621]:     <system>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="serial">7d493459-5f13-4636-af59-35825af940e9</entry>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="uuid">7d493459-5f13-4636-af59-35825af940e9</entry>
Nov 27 23:00:55 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:00:55 user nova-compute[75621]:     </system>
Nov 27 23:00:55 user nova-compute[75621]:   </sysinfo>
Nov 27 23:00:55 user nova-compute[75621]:   <os>
Nov 27 23:00:55 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:00:55 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:00:55 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:00:55 user nova-compute[75621]:   </os>
Nov 27 23:00:55 user nova-compute[75621]:   <features>
Nov 27 23:00:55 user nova-compute[75621]:     <acpi/>
Nov 27 23:00:55 user nova-compute[75621]:     <apic/>
Nov 27 23:00:55 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:00:55 user nova-compute[75621]:   </features>
Nov 27 23:00:55 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:00:55 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:00:55 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:00:55 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:00:55 user nova-compute[75621]:   </clock>
Nov 27 23:00:55 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:00:55 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:00:55 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:00:55 user nova-compute[75621]:   </cpu>
Nov 27 23:00:55 user nova-compute[75621]:   <devices>
Nov 27 23:00:55 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:00:55 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:00:55 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk"/>
Nov 27 23:00:55 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:00:55 user nova-compute[75621]:     </disk>
Nov 27 23:00:55 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:00:55 user nova-compute[75621]:       <mac address="fa:16:3e:20:12:1a"/>
Nov 27 23:00:55 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:00:55 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:00:55 user nova-compute[75621]:       <target dev="tap4182e86e-d0"/>
Nov 27 23:00:55 user nova-compute[75621]:     </interface>
Nov 27 23:00:55 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:00:55 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/console.log" append="off"/>
Nov 27 23:00:55 user nova-compute[75621]:     </serial>
Nov 27 23:00:55 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:00:55 user nova-compute[75621]:     <video>
Nov 27 23:00:55 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:00:55 user nova-compute[75621]:     </video>
Nov 27 23:00:55 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:00:55 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:00:55 user nova-compute[75621]:     </rng>
Nov 27 23:00:55 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:00:55 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:00:55 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:00:55 user nova-compute[75621]:     </memballoon>
Nov 27 23:00:55 user nova-compute[75621]:   </devices>
Nov 27 23:00:55 user nova-compute[75621]: </domain>
Nov 27 23:00:55 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1706753872',display_name='tempest-DeleteServersTestJSON-server-1706753872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1706753872',id=1,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c56e5376240c4933a75d2962d3ea0d8f',ramdisk_id='',reservation_id='r-6jiyrs20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-495956292',owner_user_name='tempest-DeleteServersTestJSON-495956292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:48Z,user_data=None,user_id='5d1fa967559449abaf467360c3e33e86',uuid=7d493459-5f13-4636-af59-35825af940e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converting VIF {"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG os_vif [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Created schema index Interface.name {{(pid=75621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Created schema index Port.name {{(pid=75621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Created schema index Bridge.name {{(pid=75621) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [POLLOUT] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c3e7775-b5a5-5ce9-aa9e-df75a58fce9f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:00:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:55 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp5b1a6mcm/privsep.sock']
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.policy [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4cbbd5877014527889b23cd592da5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af3c98f53504bd39917790819b9bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:00:55 user sudo[84944]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp5b1a6mcm/privsep.sock
Nov 27 23:00:55 user sudo[84944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-changed-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Refreshing instance network info cache due to event network-changed-057da8d3-ad29-4b83-914e-44bb4bda7361. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:00:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] Acquiring lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:00:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Creating image(s)
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "/opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.164s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk 1073741824" returned: 0 in 0.046s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updated VIF entry in instance network info cache for port 4182e86e-d05e-4f90-bef4-bf7979644e49. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updating instance_info_cache with network_info: [{"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-15422e2d-06f7-4d4e-b0b5-ae030fbee4fa req-a7e0b9d7-3000-44ef-920c-5ae24a024333 service nova] Releasing lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Cannot resize image /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Ensure instance console log exists: /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Instance network_info: |[{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] Acquired lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Refreshing network info cache for port 057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Start _get_guest_xml network_info=[{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:00:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:00:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500141362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500141362',id=3,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-womi1fjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:53Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=f13a1f06-0c06-46df-b958-bfc33d6272fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid f13a1f06-0c06-46df-b958-bfc33d6272fa {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:00:57 user nova-compute[75621]:   <uuid>f13a1f06-0c06-46df-b958-bfc33d6272fa</uuid>
Nov 27 23:00:57 user nova-compute[75621]:   <name>instance-00000003</name>
Nov 27 23:00:57 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:00:57 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:00:57 user nova-compute[75621]:   <metadata>
Nov 27 23:00:57 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:00:57 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1500141362</nova:name>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:00:56</nova:creationTime>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:00:57 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:00:57 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:owner>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:00:57 user nova-compute[75621]:       </nova:owner>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:00:57 user nova-compute[75621]:       <nova:ports>
Nov 27 23:00:57 user nova-compute[75621]:         <nova:port uuid="057da8d3-ad29-4b83-914e-44bb4bda7361">
Nov 27 23:00:57 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 23:00:57 user nova-compute[75621]:         </nova:port>
Nov 27 23:00:57 user nova-compute[75621]:       </nova:ports>
Nov 27 23:00:57 user nova-compute[75621]:     </nova:instance>
Nov 27 23:00:57 user nova-compute[75621]:   </metadata>
Nov 27 23:00:57 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:00:57 user nova-compute[75621]:     <system>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="serial">f13a1f06-0c06-46df-b958-bfc33d6272fa</entry>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="uuid">f13a1f06-0c06-46df-b958-bfc33d6272fa</entry>
Nov 27 23:00:57 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:00:57 user nova-compute[75621]:     </system>
Nov 27 23:00:57 user nova-compute[75621]:   </sysinfo>
Nov 27 23:00:57 user nova-compute[75621]:   <os>
Nov 27 23:00:57 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:00:57 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:00:57 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:00:57 user nova-compute[75621]:   </os>
Nov 27 23:00:57 user nova-compute[75621]:   <features>
Nov 27 23:00:57 user nova-compute[75621]:     <acpi/>
Nov 27 23:00:57 user nova-compute[75621]:     <apic/>
Nov 27 23:00:57 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:00:57 user nova-compute[75621]:   </features>
Nov 27 23:00:57 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:00:57 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:00:57 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:00:57 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:00:57 user nova-compute[75621]:   </clock>
Nov 27 23:00:57 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:00:57 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:00:57 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:00:57 user nova-compute[75621]:   </cpu>
Nov 27 23:00:57 user nova-compute[75621]:   <devices>
Nov 27 23:00:57 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:00:57 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:00:57 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk"/>
Nov 27 23:00:57 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:00:57 user nova-compute[75621]:     </disk>
Nov 27 23:00:57 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:00:57 user nova-compute[75621]:       <mac address="fa:16:3e:bc:81:4d"/>
Nov 27 23:00:57 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:00:57 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:00:57 user nova-compute[75621]:       <target dev="tap057da8d3-ad"/>
Nov 27 23:00:57 user nova-compute[75621]:     </interface>
Nov 27 23:00:57 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:00:57 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/console.log" append="off"/>
Nov 27 23:00:57 user nova-compute[75621]:     </serial>
Nov 27 23:00:57 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:00:57 user nova-compute[75621]:     <video>
Nov 27 23:00:57 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:00:57 user nova-compute[75621]:     </video>
Nov 27 23:00:57 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:00:57 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:00:57 user nova-compute[75621]:     </rng>
Nov 27 23:00:57 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:00:57 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:00:57 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:00:57 user nova-compute[75621]:     </memballoon>
Nov 27 23:00:57 user nova-compute[75621]:   </devices>
Nov 27 23:00:57 user nova-compute[75621]: </domain>
Nov 27 23:00:57 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500141362',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500141362',id=3,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-womi1fjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:53Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=f13a1f06-0c06-46df-b958-bfc33d6272fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG os_vif [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25a12acf-f319-5233-aa5b-32386c2e228f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:00:57 user sudo[84944]: pam_unix(sudo:session): session closed for user root
Nov 27 23:00:57 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Spawned new privsep daemon via rootwrap
Nov 27 23:00:57 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 23:00:57 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 23:00:57 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 27 23:00:57 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84962
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: WARNING oslo_privsep.priv_context [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] privsep daemon already running
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Successfully created port: 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:00:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4182e86e-d0, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4182e86e-d0, col_values=(('qos', UUID('c0b79463-c5d8-4423-8cfa-c33c2e6e5872')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4182e86e-d0, col_values=(('external_ids', {'iface-id': '4182e86e-d05e-4f90-bef4-bf7979644e49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:12:1a', 'vm-uuid': '7d493459-5f13-4636-af59-35825af940e9'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:58 user nova-compute[75621]: INFO os_vif [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0')
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap057da8d3-ad, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap057da8d3-ad, col_values=(('qos', UUID('9afa1a62-c0b9-40ca-a612-ca79ba2daf1f')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap057da8d3-ad, col_values=(('external_ids', {'iface-id': '057da8d3-ad29-4b83-914e-44bb4bda7361', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:81:4d', 'vm-uuid': 'f13a1f06-0c06-46df-b958-bfc33d6272fa'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:00:58 user nova-compute[75621]: INFO os_vif [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad')
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] No VIF found with MAC fa:16:3e:20:12:1a, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:bc:81:4d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Successfully updated port: 37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-changed-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Refreshing instance network info cache due to event network-changed-37e89c03-0357-46ad-9765-d16725a8dca6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:00:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:00:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updated VIF entry in instance network info cache for port 057da8d3-ad29-4b83-914e-44bb4bda7361. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:00:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:00:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3753c505-2b4a-451e-8bcb-40a515488d1b req-91e65885-ae42-40e3-8269-a8bfb39b02d7 service nova] Releasing lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:00:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Successfully created port: 5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance network_info: |[{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Refreshing network info cache for port 37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start _get_guest_xml network_info=[{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.objects.instance [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'pci_devices' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:00 user nova-compute[75621]:   <uuid>db2447ed-f456-41e5-b4bd-2dc243ad6c33</uuid>
Nov 27 23:01:00 user nova-compute[75621]:   <name>instance-00000002</name>
Nov 27 23:01:00 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:00 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:00 user nova-compute[75621]:   <metadata>
Nov 27 23:01:00 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:00 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherB-server-774787445</nova:name>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:00</nova:creationTime>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:00 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:00 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:user uuid="f116260296b94e55916e029d103f2126">tempest-ServerActionsTestOtherB-236791637-project-member</nova:user>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:project uuid="776ddd88f0e543769f6e275217231ecd">tempest-ServerActionsTestOtherB-236791637</nova:project>
Nov 27 23:01:00 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:00 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:00 user nova-compute[75621]:         <nova:port uuid="37e89c03-0357-46ad-9765-d16725a8dca6">
Nov 27 23:01:00 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:01:00 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:00 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:00 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:00 user nova-compute[75621]:   </metadata>
Nov 27 23:01:00 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:00 user nova-compute[75621]:     <system>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="serial">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="uuid">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:01:00 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:00 user nova-compute[75621]:     </system>
Nov 27 23:01:00 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:00 user nova-compute[75621]:   <os>
Nov 27 23:01:00 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:00 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:00 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:00 user nova-compute[75621]:   </os>
Nov 27 23:01:00 user nova-compute[75621]:   <features>
Nov 27 23:01:00 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:00 user nova-compute[75621]:     <apic/>
Nov 27 23:01:00 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:00 user nova-compute[75621]:   </features>
Nov 27 23:01:00 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:00 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:00 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:00 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:00 user nova-compute[75621]:   </clock>
Nov 27 23:01:00 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:00 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:00 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:00 user nova-compute[75621]:   </cpu>
Nov 27 23:01:00 user nova-compute[75621]:   <devices>
Nov 27 23:01:00 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:00 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:00 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk"/>
Nov 27 23:01:00 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:00 user nova-compute[75621]:     </disk>
Nov 27 23:01:00 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:00 user nova-compute[75621]:       <mac address="fa:16:3e:c7:38:3e"/>
Nov 27 23:01:00 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:00 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:00 user nova-compute[75621]:       <target dev="tap37e89c03-03"/>
Nov 27 23:01:00 user nova-compute[75621]:     </interface>
Nov 27 23:01:00 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:00 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/console.log" append="off"/>
Nov 27 23:01:00 user nova-compute[75621]:     </serial>
Nov 27 23:01:00 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:00 user nova-compute[75621]:     <video>
Nov 27 23:01:00 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:00 user nova-compute[75621]:     </video>
Nov 27 23:01:00 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:00 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:00 user nova-compute[75621]:     </rng>
Nov 27 23:01:00 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:00 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:00 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:00 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:00 user nova-compute[75621]:   </devices>
Nov 27 23:01:00 user nova-compute[75621]: </domain>
Nov 27 23:01:00 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG os_vif [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c9edd9e-acf0-5757-a6e0-90235a8d6978', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e89c03-03, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37e89c03-03, col_values=(('qos', UUID('83aa1a76-35d9-4fac-8dce-c3af4d10088e')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37e89c03-03, col_values=(('external_ids', {'iface-id': '37e89c03-0357-46ad-9765-d16725a8dca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:38:3e', 'vm-uuid': 'db2447ed-f456-41e5-b4bd-2dc243ad6c33'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: INFO os_vif [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No VIF found with MAC fa:16:3e:c7:38:3e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Successfully updated port: 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-changed-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Refreshing instance network info cache due to event network-changed-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Successfully updated port: 5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing instance network info cache due to event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Instance network_info: |[{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Start _get_guest_xml network_info=[{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-50549532',display_name='tempest-ServerActionsTestOtherA-server-50549532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-50549532',id=5,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-7o8rdluc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=6573b4cf-062d-4beb-b387-1f0966fd1ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'pci_devices' on Instance uuid 6573b4cf-062d-4beb-b387-1f0966fd1ae8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updated VIF entry in instance network info cache for port 37e89c03-0357-46ad-9765-d16725a8dca6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:02 user nova-compute[75621]:   <uuid>6573b4cf-062d-4beb-b387-1f0966fd1ae8</uuid>
Nov 27 23:01:02 user nova-compute[75621]:   <name>instance-00000005</name>
Nov 27 23:01:02 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:02 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:02 user nova-compute[75621]:   <metadata>
Nov 27 23:01:02 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:02 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherA-server-50549532</nova:name>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:02</nova:creationTime>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:02 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:user uuid="d4cbbd5877014527889b23cd592da5f0">tempest-ServerActionsTestOtherA-1166847266-project-member</nova:user>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:project uuid="7af3c98f53504bd39917790819b9bae6">tempest-ServerActionsTestOtherA-1166847266</nova:project>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:port uuid="5032c209-fff8-4169-bf18-7b6a18a53d1a">
Nov 27 23:01:02 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 23:01:02 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:02 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:02 user nova-compute[75621]:   </metadata>
Nov 27 23:01:02 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:02 user nova-compute[75621]:     <system>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="serial">6573b4cf-062d-4beb-b387-1f0966fd1ae8</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="uuid">6573b4cf-062d-4beb-b387-1f0966fd1ae8</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:02 user nova-compute[75621]:     </system>
Nov 27 23:01:02 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:02 user nova-compute[75621]:   <os>
Nov 27 23:01:02 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:02 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:02 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:02 user nova-compute[75621]:   </os>
Nov 27 23:01:02 user nova-compute[75621]:   <features>
Nov 27 23:01:02 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:02 user nova-compute[75621]:     <apic/>
Nov 27 23:01:02 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:02 user nova-compute[75621]:   </features>
Nov 27 23:01:02 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:02 user nova-compute[75621]:   </clock>
Nov 27 23:01:02 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:02 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:02 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:02 user nova-compute[75621]:   </cpu>
Nov 27 23:01:02 user nova-compute[75621]:   <devices>
Nov 27 23:01:02 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:02 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:02 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk"/>
Nov 27 23:01:02 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:     </disk>
Nov 27 23:01:02 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:02 user nova-compute[75621]:       <mac address="fa:16:3e:2a:9e:82"/>
Nov 27 23:01:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:02 user nova-compute[75621]:       <target dev="tap5032c209-ff"/>
Nov 27 23:01:02 user nova-compute[75621]:     </interface>
Nov 27 23:01:02 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:02 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/console.log" append="off"/>
Nov 27 23:01:02 user nova-compute[75621]:     </serial>
Nov 27 23:01:02 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:02 user nova-compute[75621]:     <video>
Nov 27 23:01:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:     </video>
Nov 27 23:01:02 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:02 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:02 user nova-compute[75621]:     </rng>
Nov 27 23:01:02 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:02 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:02 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:02 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:02 user nova-compute[75621]:   </devices>
Nov 27 23:01:02 user nova-compute[75621]: </domain>
Nov 27 23:01:02 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-50549532',display_name='tempest-ServerActionsTestOtherA-server-50549532',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-50549532',id=5,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-7o8rdluc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=6573b4cf-062d-4beb-b387-1f0966fd1ae8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG os_vif [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af5f3fa4-decc-4a25-8c8d-701d5ac6032d req-179fd8c4-a1ad-47ca-b1be-0cbb3fec5a11 service nova] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '045ebe52-05bf-5729-a6a3-76b914fcf1d8', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5032c209-ff, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5032c209-ff, col_values=(('qos', UUID('c0c7fefb-f74a-4935-88d3-079148eded91')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5032c209-ff, col_values=(('external_ids', {'iface-id': '5032c209-fff8-4169-bf18-7b6a18a53d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:9e:82', 'vm-uuid': '6573b4cf-062d-4beb-b387-1f0966fd1ae8'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: INFO os_vif [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff')
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:2a:9e:82, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance network_info: |[{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Refreshing network info cache for port 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start _get_guest_xml network_info=[{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'pci_devices' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:02 user nova-compute[75621]:   <uuid>b04a6cd0-3193-4b86-8563-1d889000e76e</uuid>
Nov 27 23:01:02 user nova-compute[75621]:   <name>instance-00000004</name>
Nov 27 23:01:02 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:02 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:02 user nova-compute[75621]:   <metadata>
Nov 27 23:01:02 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:02 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeTestJSON-server-1291519920</nova:name>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:02</nova:creationTime>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:02 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:user uuid="cc5cf604fbfd4f1dbdbe80b05f540425">tempest-AttachVolumeTestJSON-1955560544-project-member</nova:user>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:project uuid="ea584e6a3e6b441d8fdec3f91a1c23ed">tempest-AttachVolumeTestJSON-1955560544</nova:project>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:02 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:02 user nova-compute[75621]:         <nova:port uuid="1b9f496e-4328-4bc8-9744-d6e3d2c3df4f">
Nov 27 23:01:02 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:01:02 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:02 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:02 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:02 user nova-compute[75621]:   </metadata>
Nov 27 23:01:02 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:02 user nova-compute[75621]:     <system>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="serial">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="uuid">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:01:02 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:02 user nova-compute[75621]:     </system>
Nov 27 23:01:02 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:02 user nova-compute[75621]:   <os>
Nov 27 23:01:02 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:02 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:02 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:02 user nova-compute[75621]:   </os>
Nov 27 23:01:02 user nova-compute[75621]:   <features>
Nov 27 23:01:02 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:02 user nova-compute[75621]:     <apic/>
Nov 27 23:01:02 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:02 user nova-compute[75621]:   </features>
Nov 27 23:01:02 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:02 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:02 user nova-compute[75621]:   </clock>
Nov 27 23:01:02 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:02 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:02 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:02 user nova-compute[75621]:   </cpu>
Nov 27 23:01:02 user nova-compute[75621]:   <devices>
Nov 27 23:01:02 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:02 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:02 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk"/>
Nov 27 23:01:02 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:     </disk>
Nov 27 23:01:02 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:02 user nova-compute[75621]:       <mac address="fa:16:3e:0e:a3:79"/>
Nov 27 23:01:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:02 user nova-compute[75621]:       <target dev="tap1b9f496e-43"/>
Nov 27 23:01:02 user nova-compute[75621]:     </interface>
Nov 27 23:01:02 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:02 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/console.log" append="off"/>
Nov 27 23:01:02 user nova-compute[75621]:     </serial>
Nov 27 23:01:02 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:02 user nova-compute[75621]:     <video>
Nov 27 23:01:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:02 user nova-compute[75621]:     </video>
Nov 27 23:01:02 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:02 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:02 user nova-compute[75621]:     </rng>
Nov 27 23:01:02 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:02 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:02 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:02 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:02 user nova-compute[75621]:   </devices>
Nov 27 23:01:02 user nova-compute[75621]: </domain>
Nov 27 23:01:02 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:00:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG os_vif [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27256700-d9e3-5738-9fb4-eee93f739db8', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b9f496e-43, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b9f496e-43, col_values=(('qos', UUID('2ead1257-6a1e-4117-ae32-a384cd19220e')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b9f496e-43, col_values=(('external_ids', {'iface-id': '1b9f496e-4328-4bc8-9744-d6e3d2c3df4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a3:79', 'vm-uuid': 'b04a6cd0-3193-4b86-8563-1d889000e76e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: INFO os_vif [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No VIF found with MAC fa:16:3e:0e:a3:79, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated VIF entry in instance network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c255c3fd-e069-4bbf-b924-1479d0a43e8f req-7d0c2d6c-0214-4fa9-aa62-bf32efef426e service nova] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updated VIF entry in instance network info cache for port 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6e78ee2e-c4b4-4c99-a2d5-fa2e702608fd req-eadfabb1-98ee-4576-a014-fa042fe6f800 service nova] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] Instance spawned successfully.
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:05 user nova-compute[75621]: INFO nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Took 17.81 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:06 user nova-compute[75621]: INFO nova.compute.manager [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Took 18.98 seconds to build instance.
Nov 27 23:01:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b64d60c4-fea3-4345-9fa2-bec4e7ce39ba tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.175s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Instance spawned successfully.
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:06 user nova-compute[75621]: INFO nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Took 13.36 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:07 user nova-compute[75621]: INFO nova.compute.manager [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Took 14.33 seconds to build instance.
Nov 27 23:01:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2f8803bc-90bd-45a4-99ba-ea48e1d150af tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.521s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] No waiting events found dispatching network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:07 user nova-compute[75621]: WARNING nova.compute.manager [req-e476813b-9f57-414f-8267-441ac40bf19b req-936ebca7-5011-40d9-8894-73024bbd42db service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received unexpected event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 for instance with vm_state active and task_state None.
Nov 27 23:01:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance spawned successfully.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Instance spawned successfully.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] No waiting events found dispatching network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:09 user nova-compute[75621]: WARNING nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received unexpected event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 for instance with vm_state active and task_state None.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] No waiting events found dispatching network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:09 user nova-compute[75621]: WARNING nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received unexpected event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a for instance with vm_state building and task_state spawning.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] No waiting events found dispatching network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:09 user nova-compute[75621]: WARNING nova.compute.manager [req-546db9fa-d536-4618-b884-67862c945289 req-f90efc88-c453-4358-a504-bd2a1d474c03 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received unexpected event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a for instance with vm_state building and task_state spawning.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance spawned successfully.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Took 17.36 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Took 13.63 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Took 15.27 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.compute.manager [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Took 15.05 seconds to build instance.
Nov 27 23:01:09 user nova-compute[75621]: INFO nova.compute.manager [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Took 18.30 seconds to build instance.
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-342c8d7d-d93e-4343-b2dc-80a85f82d6ef tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.183s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-daf9d9ec-4b11-493f-81d9-958357d25a27 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.456s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:10 user nova-compute[75621]: INFO nova.compute.manager [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Took 16.29 seconds to build instance.
Nov 27 23:01:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7bb08ad6-6cb4-4f33-91c1-46f5877f1893 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.464s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:13 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:01:13 user nova-compute[75621]: INFO nova.compute.claims [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Claim successful on node user
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:01:14 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.policy [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2422e8bffd4431987796d85a5d5fcc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1004a6f33134793a0cc103283938f9d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:01:14 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Creating image(s)
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "b663489974d44ee609fc93ad4428c2d8a173363e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "b663489974d44ee609fc93ad4428c2d8a173363e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:01:14 user nova-compute[75621]: INFO nova.compute.claims [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Claim successful on node user
Nov 27 23:01:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.part --force-share --output=json" returned: 0 in 0.248s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG nova.virt.images [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] 8f96f4d1-f0ca-42cb-ac52-06251945db8c was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.part /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Successfully created port: 47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.part /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.converted" returned: 0 in 0.364s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.113s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.133s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:01:16 user nova-compute[75621]: INFO nova.compute.claims [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Claim successful on node user
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:01:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e.converted --force-share --output=json" returned: 0 in 0.324s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "b663489974d44ee609fc93ad4428c2d8a173363e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.451s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.policy [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84427eb8d68248c0ba849904dc3cbb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d33d270e0a49cba0e556853f679e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:01:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Creating image(s)
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "/opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "/opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "/opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json" returned: 0 in 0.351s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "b663489974d44ee609fc93ad4428c2d8a173363e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "b663489974d44ee609fc93ad4428c2d8a173363e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.338s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json" returned: 0 in 0.401s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e,backing_fmt=raw /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] No waiting events found dispatching network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:17 user nova-compute[75621]: WARNING nova.compute.manager [req-644f3bde-7990-4eb1-aae8-a47ec19154c1 req-29410077-9013-4b53-85b2-7070009c0e52 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received unexpected event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 for instance with vm_state active and task_state None.
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Successfully updated port: 47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e,backing_fmt=raw /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk 1073741824" returned: 0 in 0.128s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "b663489974d44ee609fc93ad4428c2d8a173363e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.535s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquired lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.455s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-changed-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Refreshing instance network info cache due to event network-changed-47e511ef-668a-4ed7-9e49-ccb3719723a5. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] Acquiring lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk 1073741824" returned: 0 in 0.282s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.761s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e --force-share --output=json" returned: 0 in 0.566s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:01:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.314s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json" returned: 0 in 0.347s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Cannot resize image /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Ensure instance console log exists: /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.143s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:01:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Cannot resize image /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Ensure instance console log exists: /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.policy [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '933ec913fbde47aa90a41d1e7d74d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301d1c9794924637ba360f1c18ffc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updating instance_info_cache with network_info: [{"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Releasing lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Instance network_info: |[{"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] Acquired lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Refreshing network info cache for port 47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Start _get_guest_xml network_info=[{"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:01:03Z,direct_url=<?>,disk_format='qcow2',id=8f96f4d1-f0ca-42cb-ac52-06251945db8c,min_disk=0,min_ram=0,name='',owner='f89e14c8070448c49ebc3bf20b95d471',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:01:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_format': None, 'encrypted': False, 'image_id': '8f96f4d1-f0ca-42cb-ac52-06251945db8c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:01:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Creating image(s)
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Successfully created port: d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:01:03Z,direct_url=<?>,disk_format='qcow2',id=8f96f4d1-f0ca-42cb-ac52-06251945db8c,min_disk=0,min_ram=0,name='',owner='f89e14c8070448c49ebc3bf20b95d471',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:01:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2076222191',display_name='tempest-AttachSCSIVolumeTestJSON-server-2076222191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2076222191',id=6,image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM+Bfdjrc1z6m5Eg3rYjr4sKoT9/7HmKHm9lOfqSoK/EFoc1lWSu8bloRjwlgV3xFo5SOarsLfJGo3jR3YD/aECNJ0WwSTUnoGH0UPC2F4as31mXRYm1pgg0dwlWSz4Kg==',key_name='tempest-keypair-1570238364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1004a6f33134793a0cc103283938f9d',ramdisk_id='',reservation_id='r-oc3nnq7w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-730684174',owner_user_name='tempest-AttachSCSIVolumeTestJSON-730684174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2422e8bffd4431987796d85a5d5fcc8',uuid=5875141e-b743-4f59-a26d-b35226c182e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converting VIF {"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lazy-loading 'pci_devices' on Instance uuid 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:19 user nova-compute[75621]:   <uuid>5875141e-b743-4f59-a26d-b35226c182e0</uuid>
Nov 27 23:01:19 user nova-compute[75621]:   <name>instance-00000006</name>
Nov 27 23:01:19 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:19 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:19 user nova-compute[75621]:   <metadata>
Nov 27 23:01:19 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:19 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2076222191</nova:name>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:18</nova:creationTime>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:19 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:19 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:user uuid="a2422e8bffd4431987796d85a5d5fcc8">tempest-AttachSCSIVolumeTestJSON-730684174-project-member</nova:user>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:project uuid="d1004a6f33134793a0cc103283938f9d">tempest-AttachSCSIVolumeTestJSON-730684174</nova:project>
Nov 27 23:01:19 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:root type="image" uuid="8f96f4d1-f0ca-42cb-ac52-06251945db8c"/>
Nov 27 23:01:19 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:19 user nova-compute[75621]:         <nova:port uuid="47e511ef-668a-4ed7-9e49-ccb3719723a5">
Nov 27 23:01:19 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:01:19 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:19 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:19 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:19 user nova-compute[75621]:   </metadata>
Nov 27 23:01:19 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:19 user nova-compute[75621]:     <system>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="serial">5875141e-b743-4f59-a26d-b35226c182e0</entry>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="uuid">5875141e-b743-4f59-a26d-b35226c182e0</entry>
Nov 27 23:01:19 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:19 user nova-compute[75621]:     </system>
Nov 27 23:01:19 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:19 user nova-compute[75621]:   <os>
Nov 27 23:01:19 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:19 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:19 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:19 user nova-compute[75621]:   </os>
Nov 27 23:01:19 user nova-compute[75621]:   <features>
Nov 27 23:01:19 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:19 user nova-compute[75621]:     <apic/>
Nov 27 23:01:19 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:19 user nova-compute[75621]:   </features>
Nov 27 23:01:19 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:19 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:19 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:19 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:19 user nova-compute[75621]:   </clock>
Nov 27 23:01:19 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:19 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:19 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:19 user nova-compute[75621]:   </cpu>
Nov 27 23:01:19 user nova-compute[75621]:   <devices>
Nov 27 23:01:19 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:19 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:19 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk"/>
Nov 27 23:01:19 user nova-compute[75621]:       <target dev="sda" bus="scsi"/>
Nov 27 23:01:19 user nova-compute[75621]:       <address type="drive" controller="0" unit="0"/>
Nov 27 23:01:19 user nova-compute[75621]:     </disk>
Nov 27 23:01:19 user nova-compute[75621]:     <disk type="file" device="cdrom">
Nov 27 23:01:19 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 23:01:19 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.config"/>
Nov 27 23:01:19 user nova-compute[75621]:       <target dev="sdb" bus="scsi"/>
Nov 27 23:01:19 user nova-compute[75621]:       <address type="drive" controller="0" unit="1"/>
Nov 27 23:01:19 user nova-compute[75621]:     </disk>
Nov 27 23:01:19 user nova-compute[75621]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 27 23:01:19 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:19 user nova-compute[75621]:       <mac address="fa:16:3e:d9:e4:db"/>
Nov 27 23:01:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:19 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:19 user nova-compute[75621]:       <target dev="tap47e511ef-66"/>
Nov 27 23:01:19 user nova-compute[75621]:     </interface>
Nov 27 23:01:19 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:19 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/console.log" append="off"/>
Nov 27 23:01:19 user nova-compute[75621]:     </serial>
Nov 27 23:01:19 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:19 user nova-compute[75621]:     <video>
Nov 27 23:01:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:19 user nova-compute[75621]:     </video>
Nov 27 23:01:19 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:19 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:19 user nova-compute[75621]:     </rng>
Nov 27 23:01:19 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:19 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:19 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:19 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:19 user nova-compute[75621]:   </devices>
Nov 27 23:01:19 user nova-compute[75621]: </domain>
Nov 27 23:01:19 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2076222191',display_name='tempest-AttachSCSIVolumeTestJSON-server-2076222191',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2076222191',id=6,image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM+Bfdjrc1z6m5Eg3rYjr4sKoT9/7HmKHm9lOfqSoK/EFoc1lWSu8bloRjwlgV3xFo5SOarsLfJGo3jR3YD/aECNJ0WwSTUnoGH0UPC2F4as31mXRYm1pgg0dwlWSz4Kg==',key_name='tempest-keypair-1570238364',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1004a6f33134793a0cc103283938f9d',ramdisk_id='',reservation_id='r-oc3nnq7w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-730684174',owner_user_name='tempest-AttachSCSIVolumeTestJSON-730684174-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2422e8bffd4431987796d85a5d5fcc8',uuid=5875141e-b743-4f59-a26d-b35226c182e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converting VIF {"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG os_vif [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.296s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd0cbe344-448a-535b-8ca3-fe70ffdec54c', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e511ef-66, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e511ef-66, col_values=(('qos', UUID('3833edc4-8941-42b1-b942-8a29080a9fe8')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e511ef-66, col_values=(('external_ids', {'iface-id': '47e511ef-668a-4ed7-9e49-ccb3719723a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:e4:db', 'vm-uuid': '5875141e-b743-4f59-a26d-b35226c182e0'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:19 user nova-compute[75621]: INFO os_vif [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66')
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] No waiting events found dispatching network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:19 user nova-compute[75621]: WARNING nova.compute.manager [req-96b118fa-f3e2-4135-ae42-351a3146c87d req-74aa39b3-dafc-4f40-87d4-6f100bf31a29 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received unexpected event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 for instance with vm_state active and task_state None.
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.292s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No BDM found with device name sda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No VIF found with MAC fa:16:3e:d9:e4:db, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Using config drive
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk 1073741824" returned: 0 in 0.099s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.241s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Cannot resize image /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Ensure instance console log exists: /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updated VIF entry in instance network info cache for port 47e511ef-668a-4ed7-9e49-ccb3719723a5. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updating instance_info_cache with network_info: [{"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fef529b9-e820-4874-8a3a-1f6d46f20420 req-f35f1b58-3d3c-4083-9d3f-94f71dc6ec65 service nova] Releasing lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Successfully created port: d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Creating config drive at /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.config
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd7iv1sab {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Successfully updated port: d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpd7iv1sab" returned: 0 in 0.066s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-changed-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Refreshing instance network info cache due to event network-changed-d340b0c4-29e1-4243-a87b-92171c11212e. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] Acquiring lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] Acquired lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Refreshing network info cache for port d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Successfully updated port: d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-changed-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing instance network info cache due to event network-changed-d06cc534-9b80-4b4a-98b6-7e45fc79b89d. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef0bb317-27c9-4f54-a164-d48aa1b1b638 req-24b7a196-c7de-48c6-81f3-09c46aa2a7a7 service nova] Releasing lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquired lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Instance network_info: |[{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing network info cache for port d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Start _get_guest_xml network_info=[{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'pci_devices' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating instance_info_cache with network_info: [{"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:21 user nova-compute[75621]:   <uuid>f4db7063-348e-4c7a-97d9-1b014e453e39</uuid>
Nov 27 23:01:21 user nova-compute[75621]:   <name>instance-00000008</name>
Nov 27 23:01:21 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:21 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:21 user nova-compute[75621]:   <metadata>
Nov 27 23:01:21 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:21 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:21</nova:creationTime>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:21 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:01:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:01:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:21 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:21 user nova-compute[75621]:   </metadata>
Nov 27 23:01:21 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:21 user nova-compute[75621]:     <system>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="serial">f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="uuid">f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:21 user nova-compute[75621]:     </system>
Nov 27 23:01:21 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:21 user nova-compute[75621]:   <os>
Nov 27 23:01:21 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:21 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:21 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:21 user nova-compute[75621]:   </os>
Nov 27 23:01:21 user nova-compute[75621]:   <features>
Nov 27 23:01:21 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:21 user nova-compute[75621]:     <apic/>
Nov 27 23:01:21 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:21 user nova-compute[75621]:   </features>
Nov 27 23:01:21 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:21 user nova-compute[75621]:   </clock>
Nov 27 23:01:21 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:21 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:21 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:21 user nova-compute[75621]:   </cpu>
Nov 27 23:01:21 user nova-compute[75621]:   <devices>
Nov 27 23:01:21 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:21 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:21 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk"/>
Nov 27 23:01:21 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:     </disk>
Nov 27 23:01:21 user nova-compute[75621]:     <disk type="file" device="cdrom">
Nov 27 23:01:21 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 23:01:21 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config"/>
Nov 27 23:01:21 user nova-compute[75621]:       <target dev="hda" bus="ide"/>
Nov 27 23:01:21 user nova-compute[75621]:     </disk>
Nov 27 23:01:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:21 user nova-compute[75621]:       <mac address="fa:16:3e:fe:7a:1b"/>
Nov 27 23:01:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:21 user nova-compute[75621]:       <target dev="tapd06cc534-9b"/>
Nov 27 23:01:21 user nova-compute[75621]:     </interface>
Nov 27 23:01:21 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:21 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log" append="off"/>
Nov 27 23:01:21 user nova-compute[75621]:     </serial>
Nov 27 23:01:21 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:21 user nova-compute[75621]:     <video>
Nov 27 23:01:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:     </video>
Nov 27 23:01:21 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:21 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:21 user nova-compute[75621]:     </rng>
Nov 27 23:01:21 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:21 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:21 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:21 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:21 user nova-compute[75621]:   </devices>
Nov 27 23:01:21 user nova-compute[75621]: </domain>
Nov 27 23:01:21 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG os_vif [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Releasing lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance network_info: |[{"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Start _get_guest_xml network_info=[{"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ef6f30a-5321-57a2-b9ba-1a57b594d92d', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd06cc534-9b, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd06cc534-9b, col_values=(('qos', UUID('6bd3b067-94e5-49c8-9de6-cd20eceec4f1')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd06cc534-9b, col_values=(('external_ids', {'iface-id': 'd06cc534-9b80-4b4a-98b6-7e45fc79b89d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:7a:1b', 'vm-uuid': 'f4db7063-348e-4c7a-97d9-1b014e453e39'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: INFO os_vif [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b')
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806269045',display_name='tempest-VolumesAdminNegativeTest-server-806269045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806269045',id=7,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAidA3AGVE2W4HiizbpHqUGV3wmdb1VMUVOPxGEUFX/YnIlcfd6KVLOG5FTgDv+kQGEfUTOcap6e5HzEyAunkRjHuUR+gM6pxpoWabYQIisfdzLIokO26x0y8JLe2egcHg==',key_name='tempest-keypair-699797478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-lh89suvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=171a4eaa-6326-4946-97e6-bfc6d3d3d98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'pci_devices' on Instance uuid 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:21 user nova-compute[75621]:   <uuid>171a4eaa-6326-4946-97e6-bfc6d3d3d98f</uuid>
Nov 27 23:01:21 user nova-compute[75621]:   <name>instance-00000007</name>
Nov 27 23:01:21 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:21 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:21 user nova-compute[75621]:   <metadata>
Nov 27 23:01:21 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:21 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:name>tempest-VolumesAdminNegativeTest-server-806269045</nova:name>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:21</nova:creationTime>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:21 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:user uuid="84427eb8d68248c0ba849904dc3cbb27">tempest-VolumesAdminNegativeTest-660006676-project-member</nova:user>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:project uuid="a6d33d270e0a49cba0e556853f679e5f">tempest-VolumesAdminNegativeTest-660006676</nova:project>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:21 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:21 user nova-compute[75621]:         <nova:port uuid="d340b0c4-29e1-4243-a87b-92171c11212e">
Nov 27 23:01:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:01:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:21 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:21 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:21 user nova-compute[75621]:   </metadata>
Nov 27 23:01:21 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:21 user nova-compute[75621]:     <system>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="serial">171a4eaa-6326-4946-97e6-bfc6d3d3d98f</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="uuid">171a4eaa-6326-4946-97e6-bfc6d3d3d98f</entry>
Nov 27 23:01:21 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:21 user nova-compute[75621]:     </system>
Nov 27 23:01:21 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:21 user nova-compute[75621]:   <os>
Nov 27 23:01:21 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:21 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:21 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:21 user nova-compute[75621]:   </os>
Nov 27 23:01:21 user nova-compute[75621]:   <features>
Nov 27 23:01:21 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:21 user nova-compute[75621]:     <apic/>
Nov 27 23:01:21 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:21 user nova-compute[75621]:   </features>
Nov 27 23:01:21 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:21 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:21 user nova-compute[75621]:   </clock>
Nov 27 23:01:21 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:21 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:21 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:21 user nova-compute[75621]:   </cpu>
Nov 27 23:01:21 user nova-compute[75621]:   <devices>
Nov 27 23:01:21 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:21 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:21 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk"/>
Nov 27 23:01:21 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:     </disk>
Nov 27 23:01:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:21 user nova-compute[75621]:       <mac address="fa:16:3e:1e:bc:3e"/>
Nov 27 23:01:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:21 user nova-compute[75621]:       <target dev="tapd340b0c4-29"/>
Nov 27 23:01:21 user nova-compute[75621]:     </interface>
Nov 27 23:01:21 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:21 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/console.log" append="off"/>
Nov 27 23:01:21 user nova-compute[75621]:     </serial>
Nov 27 23:01:21 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:21 user nova-compute[75621]:     <video>
Nov 27 23:01:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:21 user nova-compute[75621]:     </video>
Nov 27 23:01:21 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:21 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:21 user nova-compute[75621]:     </rng>
Nov 27 23:01:21 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:21 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:21 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:21 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:21 user nova-compute[75621]:   </devices>
Nov 27 23:01:21 user nova-compute[75621]: </domain>
Nov 27 23:01:21 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806269045',display_name='tempest-VolumesAdminNegativeTest-server-806269045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806269045',id=7,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAidA3AGVE2W4HiizbpHqUGV3wmdb1VMUVOPxGEUFX/YnIlcfd6KVLOG5FTgDv+kQGEfUTOcap6e5HzEyAunkRjHuUR+gM6pxpoWabYQIisfdzLIokO26x0y8JLe2egcHg==',key_name='tempest-keypair-699797478',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-lh89suvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=171a4eaa-6326-4946-97e6-bfc6d3d3d98f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG os_vif [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ccbb1137-3d17-566e-a6b4-744fb35296ed', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name hda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No VIF found with MAC fa:16:3e:fe:7a:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Using config drive
Nov 27 23:01:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd340b0c4-29, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd340b0c4-29, col_values=(('qos', UUID('dad1cd31-b2ed-4c9a-90b3-0da80634f0e3')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd340b0c4-29, col_values=(('external_ids', {'iface-id': 'd340b0c4-29e1-4243-a87b-92171c11212e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:bc:3e', 'vm-uuid': '171a4eaa-6326-4946-97e6-bfc6d3d3d98f'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: INFO os_vif [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29')
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No VIF found with MAC fa:16:3e:1e:bc:3e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Creating config drive at /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config
Nov 27 23:01:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpltpnvkw1 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpltpnvkw1" returned: 0 in 0.083s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updated VIF entry in instance network info cache for port d06cc534-9b80-4b4a-98b6-7e45fc79b89d. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fed21bcb-762f-4f5d-a3a6-bfec6bc89534 req-c3dfbbe4-d95c-4bfe-97f4-cf45afa794d3 service nova] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:25 user nova-compute[75621]: WARNING nova.compute.manager [req-192ff4dc-7ebf-4c66-87db-80a1c4bf2c62 req-adda8320-c32a-43ab-a2af-594bc7c6f6b7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state active and task_state None.
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] No waiting events found dispatching network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:26 user nova-compute[75621]: WARNING nova.compute.manager [req-2ceca0aa-098f-4926-adaa-c74e4fda3a0b req-45dacdc1-51d4-4b81-a813-9d4d01b229d9 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received unexpected event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e for instance with vm_state building and task_state spawning.
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:27 user nova-compute[75621]: WARNING nova.compute.manager [req-ff232027-1ee5-422b-b04a-4be7a3b02fe9 req-17e1937b-3741-42b4-8fba-a7f977b99c7a service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state active and task_state None.
Nov 27 23:01:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Instance spawned successfully.
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:28 user nova-compute[75621]: INFO nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Took 13.74 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] No waiting events found dispatching network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:28 user nova-compute[75621]: WARNING nova.compute.manager [req-4f8935cd-aa29-48ea-91f5-37cdff044d64 req-2dbf932a-d1f4-48d1-8e9e-e31209ccba38 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received unexpected event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e for instance with vm_state building and task_state spawning.
Nov 27 23:01:28 user nova-compute[75621]: INFO nova.compute.manager [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Took 15.27 seconds to build instance.
Nov 27 23:01:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4d73d3d-1858-4c93-9840-6e0e295c9605 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.431s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.compute.claims [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Claim successful on node user
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance spawned successfully.
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Instance spawned successfully.
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Took 13.87 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Took 11.72 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.compute.manager [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Took 15.86 seconds to build instance.
Nov 27 23:01:30 user nova-compute[75621]: INFO nova.compute.manager [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Took 15.88 seconds to build instance.
Nov 27 23:01:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47c5861d-344a-46a7-9572-5f5f93fc2fa4 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.189s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4ffe406f-041e-44e5-8928-a255adab16b9 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.104s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.837s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:01:31 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.policy [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fc820bbd0de4e80a3ea40a55bab9e31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76a0b768ae50496690b977b4c5f03a56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:01:31 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Creating image(s)
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "/opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "/opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "/opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.252s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.237s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk 1073741824" returned: 0 in 0.084s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.259s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Successfully created port: de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Cannot resize image /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Ensure instance console log exists: /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] No waiting events found dispatching network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:32 user nova-compute[75621]: WARNING nova.compute.manager [req-ec7433a4-2f65-49fe-82e3-0210b8f69818 req-9644cfb3-a19e-4f8f-804b-1a3a83bc9405 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received unexpected event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 for instance with vm_state active and task_state None.
Nov 27 23:01:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Successfully updated port: de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquired lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-changed-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Refreshing instance network info cache due to event network-changed-de498b21-1fbc-4b3c-946c-4a1e5de6d392. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] Acquiring lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updating instance_info_cache with network_info: [{"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Releasing lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Instance network_info: |[{"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] Acquired lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Refreshing network info cache for port de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Start _get_guest_xml network_info=[{"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:01:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-132050560',display_name='tempest-VolumesAssistedSnapshotsTest-server-132050560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-132050560',id=9,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKO6toZMIfUyKy35Z6ZfHvrQt6hTGy2HHTe5egO06jRlAOCrC7fBWzrKcRx0II6tpsc07B0ekPFA/Sa7LqI/a9WEzz/PbV6RNLDPTODyBLMiOrHwzhMXZOvM6c9cZhcJQ==',key_name='tempest-keypair-244360235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a0b768ae50496690b977b4c5f03a56',ramdisk_id='',reservation_id='r-9ny01y22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1157325062',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1157325062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc820bbd0de4e80a3ea40a55bab9e31',uuid=dfdff3c7-4ea4-4c11-a737-71c46c844fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converting VIF {"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lazy-loading 'pci_devices' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:01:33 user nova-compute[75621]:   <uuid>dfdff3c7-4ea4-4c11-a737-71c46c844fce</uuid>
Nov 27 23:01:33 user nova-compute[75621]:   <name>instance-00000009</name>
Nov 27 23:01:33 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:01:33 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:01:33 user nova-compute[75621]:   <metadata>
Nov 27 23:01:33 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:01:33 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-132050560</nova:name>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:01:33</nova:creationTime>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:01:33 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:01:33 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:owner>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:user uuid="4fc820bbd0de4e80a3ea40a55bab9e31">tempest-VolumesAssistedSnapshotsTest-1157325062-project-member</nova:user>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:project uuid="76a0b768ae50496690b977b4c5f03a56">tempest-VolumesAssistedSnapshotsTest-1157325062</nova:project>
Nov 27 23:01:33 user nova-compute[75621]:       </nova:owner>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:01:33 user nova-compute[75621]:       <nova:ports>
Nov 27 23:01:33 user nova-compute[75621]:         <nova:port uuid="de498b21-1fbc-4b3c-946c-4a1e5de6d392">
Nov 27 23:01:33 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 23:01:33 user nova-compute[75621]:         </nova:port>
Nov 27 23:01:33 user nova-compute[75621]:       </nova:ports>
Nov 27 23:01:33 user nova-compute[75621]:     </nova:instance>
Nov 27 23:01:33 user nova-compute[75621]:   </metadata>
Nov 27 23:01:33 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:01:33 user nova-compute[75621]:     <system>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="serial">dfdff3c7-4ea4-4c11-a737-71c46c844fce</entry>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="uuid">dfdff3c7-4ea4-4c11-a737-71c46c844fce</entry>
Nov 27 23:01:33 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:01:33 user nova-compute[75621]:     </system>
Nov 27 23:01:33 user nova-compute[75621]:   </sysinfo>
Nov 27 23:01:33 user nova-compute[75621]:   <os>
Nov 27 23:01:33 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:01:33 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:01:33 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:01:33 user nova-compute[75621]:   </os>
Nov 27 23:01:33 user nova-compute[75621]:   <features>
Nov 27 23:01:33 user nova-compute[75621]:     <acpi/>
Nov 27 23:01:33 user nova-compute[75621]:     <apic/>
Nov 27 23:01:33 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:01:33 user nova-compute[75621]:   </features>
Nov 27 23:01:33 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:01:33 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:01:33 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:01:33 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:01:33 user nova-compute[75621]:   </clock>
Nov 27 23:01:33 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:01:33 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:01:33 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:01:33 user nova-compute[75621]:   </cpu>
Nov 27 23:01:33 user nova-compute[75621]:   <devices>
Nov 27 23:01:33 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:01:33 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:01:33 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk"/>
Nov 27 23:01:33 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:01:33 user nova-compute[75621]:     </disk>
Nov 27 23:01:33 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:01:33 user nova-compute[75621]:       <mac address="fa:16:3e:05:dd:4f"/>
Nov 27 23:01:33 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:33 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:01:33 user nova-compute[75621]:       <target dev="tapde498b21-1f"/>
Nov 27 23:01:33 user nova-compute[75621]:     </interface>
Nov 27 23:01:33 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:01:33 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/console.log" append="off"/>
Nov 27 23:01:33 user nova-compute[75621]:     </serial>
Nov 27 23:01:33 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:01:33 user nova-compute[75621]:     <video>
Nov 27 23:01:33 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:01:33 user nova-compute[75621]:     </video>
Nov 27 23:01:33 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:01:33 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:01:33 user nova-compute[75621]:     </rng>
Nov 27 23:01:33 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:01:33 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:01:33 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:01:33 user nova-compute[75621]:     </memballoon>
Nov 27 23:01:33 user nova-compute[75621]:   </devices>
Nov 27 23:01:33 user nova-compute[75621]: </domain>
Nov 27 23:01:33 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-132050560',display_name='tempest-VolumesAssistedSnapshotsTest-server-132050560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-132050560',id=9,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKO6toZMIfUyKy35Z6ZfHvrQt6hTGy2HHTe5egO06jRlAOCrC7fBWzrKcRx0II6tpsc07B0ekPFA/Sa7LqI/a9WEzz/PbV6RNLDPTODyBLMiOrHwzhMXZOvM6c9cZhcJQ==',key_name='tempest-keypair-244360235',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='76a0b768ae50496690b977b4c5f03a56',ramdisk_id='',reservation_id='r-9ny01y22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1157325062',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1157325062-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc820bbd0de4e80a3ea40a55bab9e31',uuid=dfdff3c7-4ea4-4c11-a737-71c46c844fce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converting VIF {"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG os_vif [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06bc655d-ddd5-5867-825a-5b0ac76db5b1', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde498b21-1f, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapde498b21-1f, col_values=(('qos', UUID('5f869a1e-74b7-4e7c-a900-512da209b77d')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapde498b21-1f, col_values=(('external_ids', {'iface-id': 'de498b21-1fbc-4b3c-946c-4a1e5de6d392', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:dd:4f', 'vm-uuid': 'dfdff3c7-4ea4-4c11-a737-71c46c844fce'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:33 user nova-compute[75621]: INFO os_vif [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f')
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:01:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] No VIF found with MAC fa:16:3e:05:dd:4f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updated VIF entry in instance network info cache for port de498b21-1fbc-4b3c-946c-4a1e5de6d392. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updating instance_info_cache with network_info: [{"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe632dd4-a8d5-4db4-bc16-439f4670f353 req-00c211d8-8290-410c-8fb1-d2dc872a9d3f service nova] Releasing lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] No waiting events found dispatching network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:34 user nova-compute[75621]: WARNING nova.compute.manager [req-d6648374-b938-4d89-b1e8-c90b7bab37fd req-256f6281-97fe-46b6-a551-6874218bd0dc service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received unexpected event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 for instance with vm_state active and task_state None.
Nov 27 23:01:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:01:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Instance spawned successfully.
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:01:38 user nova-compute[75621]: INFO nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Took 7.50 seconds to spawn the instance on the hypervisor.
Nov 27 23:01:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:01:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:39 user nova-compute[75621]: INFO nova.compute.manager [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Took 9.01 seconds to build instance.
Nov 27 23:01:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8fda3379-094c-46d3-8a44-e721406d7d4e tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.363s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:01:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:42 user nova-compute[75621]: WARNING nova.compute.manager [req-f6794da0-1cef-4bef-ab6b-a8b3b10fd792 req-47facc4b-7763-4336-99ea-78887a510bf1 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state None.
Nov 27 23:01:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:44 user nova-compute[75621]: WARNING nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state None.
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:44 user nova-compute[75621]: WARNING nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d for instance with vm_state active and task_state None.
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:44 user nova-compute[75621]: WARNING nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d for instance with vm_state active and task_state None.
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] No waiting events found dispatching network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:44 user nova-compute[75621]: WARNING nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received unexpected event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 for instance with vm_state active and task_state None.
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] No waiting events found dispatching network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:01:44 user nova-compute[75621]: WARNING nova.compute.manager [req-7122a190-eb06-43f4-bdbc-b53c3094a0cd req-573de614-23b3-4f73-832d-6212a18156bd service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received unexpected event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 for instance with vm_state active and task_state None.
Nov 27 23:01:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:01:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 7d493459-5f13-4636-af59-35825af940e9] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 7d493459-5f13-4636-af59-35825af940e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updating instance_info_cache with network_info: [{"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-7d493459-5f13-4636-af59-35825af940e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:45 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7372MB free_disk=25.510440826416016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7d493459-5f13-4636-af59-35825af940e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5875141e-b743-4f59-a26d-b35226c182e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f4db7063-348e-4c7a-97d9-1b014e453e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance dfdff3c7-4ea4-4c11-a737-71c46c844fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:01:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:01:51 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:51 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:01:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.826s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:01:52 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:01:52 user nova-compute[75621]: INFO nova.compute.claims [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Claim successful on node user
Nov 27 23:01:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:01:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:01:53 user nova-compute[75621]: INFO nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Booting with volume 03584c22-7ad5-4fd5-b535-1b04ef96a466 at /dev/vda
Nov 27 23:01:53 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:01:53 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpkzfqgf1h/privsep.sock']
Nov 27 23:01:53 user sudo[86750]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpkzfqgf1h/privsep.sock
Nov 27 23:01:53 user sudo[86750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 27 23:01:53 user nova-compute[75621]: DEBUG nova.policy [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0bd4c58b96942caaf91dacc21ce7b02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e50cf1304e5e4dd98bd232dd20902a14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:01:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully created port: 0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully created port: e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:55 user sudo[86750]: pam_unix(sudo:session): session closed for user root
Nov 27 23:01:55 user nova-compute[75621]: INFO oslo.privsep.daemon [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Spawned new privsep daemon via rootwrap
Nov 27 23:01:55 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 27 23:01:55 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 27 23:01:55 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 27 23:01:55 user nova-compute[75621]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86804
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f952d0-215b-49d8-adf1-f59e5c7f4675]: (2,) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully created port: 64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[328ee147-7935-4827-bc32-93facf74dcb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.nvmeof [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abd9418-cd13-4138-a39b-dee03038d792]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[44624a8b-b50f-4f71-9eb0-b7f6c8963f3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d688ee-0e16-45c4-b247-422d0506d0ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:01:55 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:01:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc888b20-ed4d-4d40-8247-5a9d9cfb3228]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== get_connector_properties: return (1859ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:01:55 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating existing volume attachment record: df0531d6-8dfa-41dd-9862-f2b431920af5 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:01:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully created port: f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully created port: 6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: 0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-0549eeab-0e55-4e1c-b41b-4e990f0fd13c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.network.neutron [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port 0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.network.neutron [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG nova.network.neutron [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-922f6219-205d-4413-8ebf-ef9c773af530 req-1db71e78-baf4-4932-9815-f91fa51c92dd service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: 60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-ce067877-6c3e-4646-b8ff-6f845da48953. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-60b919e7-a392-46a7-ba42-8a529177a820. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port 60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:01:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: 64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-e1962a4c-7e9a-4293-b278-e2b4efad2889. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1038a517-474a-45c9-ab5f-69be34292711 req-15904aae-8747-47d6-abe2-d50cd51307f5 service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.network.neutron [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8eccd60-dea6-474f-8492-bc76c4a99d67 req-fab560c8-9528-400c-8215-6b36120af7ce service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Successfully updated port: 6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-64c0f9a9-88e8-4946-8946-4f8fddf685a9. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-6cc83c86-666b-4862-9608-c20881403c00. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:02 user nova-compute[75621]: INFO nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Booting with volume eec1450c-6cf5-4ef0-8337-f2fa00e0be03 at /dev/vdb
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[16784da7-d28e-43cf-8b28-a752f587f7b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f426dbf-adac-46f6-9bd5-3ffe636f65db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f43a3f2-e3ff-4d3e-9646-2da3036ed04b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba6c1b1-f7b2-45d0-8463-759f175e649e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:03 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2fbd47-efbd-41ab-a79d-85fd9520e381]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating existing volume attachment record: f899890f-4b73-4403-95bc-efd8bb5d028e {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance network_info: |[{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port 64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updated VIF entry in instance network info cache for port 64c0f9a9-88e8-4946-8946-4f8fddf685a9. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-26b9c624-9b46-4997-97aa-9193592b29c1 req-87974b8a-1a59-4fee-b490-1bdc2d2cb1ba service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port 6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updated VIF entry in instance network info cache for port 6cc83c86-666b-4862-9608-c20881403c00. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cc6c2a-9d4d-45ec-8e9d-d391a079c1d1 req-aedc9d34-31d7-4375-8a3d-abff44aa725d service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:09 user nova-compute[75621]: INFO nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Booting with volume 9264d001-8919-4c33-9aa8-bcc6a511ba58 at /dev/vdc
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[527abee2-42d8-4153-bc3c-5a9cb2b1f7b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc101b9-41fc-4f51-965b-2a261e0c98f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ea0bd4-80d4-482c-969d-45ff22fe916f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa0f6bd-9b99-4588-b9c6-0c43da807601]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:10 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:02:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f7679-7630-444b-a50e-dbaaa4384d9e]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:10 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating existing volume attachment record: d26e7060-d84c-4ff3-8c84-6c12786c8e2c {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:02:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:02:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Creating image(s)
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Ensure instance console log exists: /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Start _get_guest_xml network_info=[{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'df0531d6-8dfa-41dd-9862-f2b431920af5', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJmrFEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e', 'attached_at': '', 'detached_at': '', 'volume_id': '03584c22-7ad5-4fd5-b535-1b04ef96a466', 'serial': '03584c22-7ad5-4fd5-b535-1b04ef96a466'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'f899890f-4b73-4403-95bc-efd8bb5d028e', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rkmerqcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e', 'attached_at': '', 'detached_at': '', 'volume_id': 'eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 'serial': 'eec1450c-6cf5-4ef0-8337-f2fa00e0be03'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'd26e7060-d84c-4ff3-8c84-6c12786c8e2c', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUZyBaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e', 'attached_at': '', 'detached_at': '', 'volume_id': '9264d001-8919-4c33-9aa8-bcc6a511ba58', 'serial': '9264d001-8919-4c33-9aa8-bcc6a511ba58'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:02:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connector [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Factory for ISCSI on None {{(pid=75621) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJmrFEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:17 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:17 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:17 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[930a5b71-623c-49d6-940e-f85a0cd07f8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:02:17 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a600d8-ac3a-4c17-bbac-9b907ce886d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466] added
Nov 27 23:02:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beef964-6fa8-457a-b845-d7e1da8adbb0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b6dd6-ec46-439e-86ee-503920e97caf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToJmrFEG {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ToJmrFEG" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7760a868-3a6e-4409-88b4-3cd4b0e8c99a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ToJmrFEG'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d88a7a-fe88-4e64-9fe6-36627de1bd5e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e76fa73-fede-41d1-af0e-9591c5903ecc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:02:17 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:02:17 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:17 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:02:17 user nova-compute[75621]: 
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e19afb8-49c2-46ca-8588-bd2d93838b8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260]
Nov 27 23:02:17 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c5c0f-d79a-45f0-958c-530795ad7b0f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb9e918-d928-4060-8d88-66645f8fcf7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60de801-375e-4a9f-8a94-d5df002b329b]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJmrFEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:02:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26162643731303834', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162643731303834', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rkmerqcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:18 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[455347ed-be0d-4d02-bfe9-c0d6a353297c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:02:18 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd7d04c-dc8a-4bec-821c-5376fb4730cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03] added
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0153f681-9c62-4446-9b5d-155f2b03998d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17a9e9f-f6ab-417f-902a-0141ffb885a1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Rkmerqcv {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Rkmerqcv" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb3b143-9ea3-44d9-bd49-f38eb508b044]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Rkmerqcv'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c919d9-df4f-45bc-ac89-b5a817876f79]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df70820e-547f-43f1-afe4-6c40b7bee598]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2e8d7a-cb8c-45ae-82b1-923bd5686924]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260]
Nov 27 23:02:18 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb6df9-7ed0-41cf-a708-914c55564ca2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9a0d51-9ae9-4d1e-a215-e38680c50a98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e32f3c-4a5c-4184-8f02-e29d4475992c]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rkmerqcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:02:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26436353163393531', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436353163393531', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUZyBaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:19 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b6994-fc4f-4545-9bc6-985095f2b5dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:02:19 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63aad256-8411-43b6-b4e0-8411cf702d17]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58] added
Nov 27 23:02:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e609ddc-42f0-4644-8871-807134094eab]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[246ca707-01d6-4192-9805-2cd996441418]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUZyBaI {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qCUZyBaI" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9afe34f-7182-4fea-9db8-ef5a87979177]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qCUZyBaI'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60e71eb-2b52-4d1f-9c71-5cd86cd3a737]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa33b692-ea43-403b-bde4-d31dde972f8b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff394aa-d82f-44c7-af2a-ca638a1c0069]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260]
Nov 27 23:02:20 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8fe61f-fe5b-4e19-b04c-4d893b287212]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1dfa5a-e07a-4f36-a136-a05c8ed97f22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb507b72-370b-4095-927a-1c5f89708657]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:02:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUZyBaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '23464356538376534', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464356538376534', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lazy-loading 'pci_devices' on Instance uuid 02b2be65-783d-4d2d-a968-5cfd3f62ef1e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:02:21 user nova-compute[75621]:   <uuid>02b2be65-783d-4d2d-a968-5cfd3f62ef1e</uuid>
Nov 27 23:02:21 user nova-compute[75621]:   <name>instance-0000000a</name>
Nov 27 23:02:21 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:02:21 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:02:21 user nova-compute[75621]:   <metadata>
Nov 27 23:02:21 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:02:21 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:name>tempest-device-tagging-server-1846313793</nova:name>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:02:17</nova:creationTime>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:02:21 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:02:21 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:owner>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:user uuid="b0bd4c58b96942caaf91dacc21ce7b02">tempest-TaggedBootDevicesTest_v242-778294445-project-member</nova:user>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:project uuid="e50cf1304e5e4dd98bd232dd20902a14">tempest-TaggedBootDevicesTest_v242-778294445</nova:project>
Nov 27 23:02:21 user nova-compute[75621]:       </nova:owner>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:02:21 user nova-compute[75621]:       <nova:ports>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="0549eeab-0e55-4e1c-b41b-4e990f0fd13c">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="ce067877-6c3e-4646-b8ff-6f845da48953">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="60b919e7-a392-46a7-ba42-8a529177a820">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.63" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="e1962a4c-7e9a-4293-b278-e2b4efad2889">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.195" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="64c0f9a9-88e8-4946-8946-4f8fddf685a9">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.200" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:         <nova:port uuid="6cc83c86-666b-4862-9608-c20881403c00">
Nov 27 23:02:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 23:02:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:21 user nova-compute[75621]:       </nova:ports>
Nov 27 23:02:21 user nova-compute[75621]:     </nova:instance>
Nov 27 23:02:21 user nova-compute[75621]:   </metadata>
Nov 27 23:02:21 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:02:21 user nova-compute[75621]:     <system>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="serial">02b2be65-783d-4d2d-a968-5cfd3f62ef1e</entry>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="uuid">02b2be65-783d-4d2d-a968-5cfd3f62ef1e</entry>
Nov 27 23:02:21 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:02:21 user nova-compute[75621]:     </system>
Nov 27 23:02:21 user nova-compute[75621]:   </sysinfo>
Nov 27 23:02:21 user nova-compute[75621]:   <os>
Nov 27 23:02:21 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:02:21 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:02:21 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:02:21 user nova-compute[75621]:   </os>
Nov 27 23:02:21 user nova-compute[75621]:   <features>
Nov 27 23:02:21 user nova-compute[75621]:     <acpi/>
Nov 27 23:02:21 user nova-compute[75621]:     <apic/>
Nov 27 23:02:21 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:02:21 user nova-compute[75621]:   </features>
Nov 27 23:02:21 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:02:21 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:02:21 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:02:21 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:02:21 user nova-compute[75621]:   </clock>
Nov 27 23:02:21 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:02:21 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:02:21 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:02:21 user nova-compute[75621]:   </cpu>
Nov 27 23:02:21 user nova-compute[75621]:   <devices>
Nov 27 23:02:21 user nova-compute[75621]:     <disk type="file" device="cdrom">
Nov 27 23:02:21 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 23:02:21 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/disk.config"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="hda" bus="ide"/>
Nov 27 23:02:21 user nova-compute[75621]:     </disk>
Nov 27 23:02:21 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:02:21 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:02:21 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <serial>03584c22-7ad5-4fd5-b535-1b04ef96a466</serial>
Nov 27 23:02:21 user nova-compute[75621]:     </disk>
Nov 27 23:02:21 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:02:21 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:02:21 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <serial>eec1450c-6cf5-4ef0-8337-f2fa00e0be03</serial>
Nov 27 23:02:21 user nova-compute[75621]:     </disk>
Nov 27 23:02:21 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:02:21 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:02:21 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="vdc" bus="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <serial>9264d001-8919-4c33-9aa8-bcc6a511ba58</serial>
Nov 27 23:02:21 user nova-compute[75621]:     </disk>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:54:75:58"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tap0549eeab-0e"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:0a:4a:03"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tapce067877-6c"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:ab:c1:0a"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tap60b919e7-a3"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:ea:34:a4"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tape1962a4c-7e"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:c4:19:48"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tap64c0f9a9-88"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:46:71:bd"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tapf4f8ca54-7b"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:21 user nova-compute[75621]:       <mac address="fa:16:3e:37:6e:2d"/>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:21 user nova-compute[75621]:       <target dev="tap6cc83c86-66"/>
Nov 27 23:02:21 user nova-compute[75621]:     </interface>
Nov 27 23:02:21 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:02:21 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/console.log" append="off"/>
Nov 27 23:02:21 user nova-compute[75621]:     </serial>
Nov 27 23:02:21 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:02:21 user nova-compute[75621]:     <video>
Nov 27 23:02:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:21 user nova-compute[75621]:     </video>
Nov 27 23:02:21 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:02:21 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:02:21 user nova-compute[75621]:     </rng>
Nov 27 23:02:21 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:02:21 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:02:21 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:02:21 user nova-compute[75621]:     </memballoon>
Nov 27 23:02:21 user nova-compute[75621]:   </devices>
Nov 27 23:02:21 user nova-compute[75621]: </domain>
Nov 27 23:02:21 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcf974d0-0118-56a2-b43d-81a6a604e29b', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0549eeab-0e, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0549eeab-0e, col_values=(('qos', UUID('861af2d9-bfb5-4fc7-802d-47c99e93b564')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0549eeab-0e, col_values=(('external_ids', {'iface-id': '0549eeab-0e55-4e1c-b41b-4e990f0fd13c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:75:58', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '054e890f-6716-5828-99eb-0d64e7d6391c', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce067877-6c, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce067877-6c, col_values=(('qos', UUID('f3df3f1a-ebcc-4d24-9710-aae6e1fc7347')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce067877-6c, col_values=(('external_ids', {'iface-id': 'ce067877-6c3e-4646-b8ff-6f845da48953', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:4a:03', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a1600c6-b203-5fce-8e56-5eaba4aba162', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60b919e7-a3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60b919e7-a3, col_values=(('qos', UUID('532830dd-81a2-4d04-8eb0-a5b85e8f4e7b')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60b919e7-a3, col_values=(('external_ids', {'iface-id': '60b919e7-a392-46a7-ba42-8a529177a820', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:c1:0a', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e0474b6-8930-51ae-8f3b-94b75c079e22', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1962a4c-7e, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1962a4c-7e, col_values=(('qos', UUID('563073b1-8ee0-4a3b-a100-f1aecfecba4e')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1962a4c-7e, col_values=(('external_ids', {'iface-id': 'e1962a4c-7e9a-4293-b278-e2b4efad2889', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:34:a4', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63c20784-2b0a-5e36-981f-4155986deed4', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64c0f9a9-88, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64c0f9a9-88, col_values=(('qos', UUID('d86079bb-8cd2-4c08-aae9-93b66e4fdb3f')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64c0f9a9-88, col_values=(('external_ids', {'iface-id': '64c0f9a9-88e8-4946-8946-4f8fddf685a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:19:48', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b4a7164-4b30-58b3-bdb1-a3cfc906cc13', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4f8ca54-7b, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf4f8ca54-7b, col_values=(('qos', UUID('aabfd5bc-1770-4d73-b710-d67438b4a358')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf4f8ca54-7b, col_values=(('external_ids', {'iface-id': 'f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:71:bd', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:01:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '310b4bd3-2f81-587b-b0d6-db7c1f813a9f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc83c86-66, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cc83c86-66, col_values=(('qos', UUID('0bb7ba1d-85b8-4988-8145-097fb0ae51a8')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cc83c86-66, col_values=(('external_ids', {'iface-id': '6cc83c86-666b-4862-9608-c20881403c00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:6e:2d', 'vm-uuid': '02b2be65-783d-4d2d-a968-5cfd3f62ef1e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:21 user nova-compute[75621]: INFO os_vif [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66')
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] No BDM found with device name hda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] No VIF found with MAC fa:16:3e:54:75:58, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:02:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] No VIF found with MAC fa:16:3e:c4:19:48, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:02:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Using config drive
Nov 27 23:02:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Creating config drive at /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/disk.config
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbb4vflr9 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbb4vflr9" returned: 0 in 0.057s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:22 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:02:22 user nova-compute[75621]: INFO nova.compute.claims [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Claim successful on node user
Nov 27 23:02:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:02:23 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.policy [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2f1941d34224041bbbfd15a08301b6d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c5a4463276244c1b9138b190e65d9e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:02:23 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Creating image(s)
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "/opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "/opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "/opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Successfully created port: 3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk 1073741824" returned: 0 in 0.049s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Checking if we can resize image /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:02:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Cannot resize image /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Ensure instance console log exists: /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Successfully updated port: 3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquired lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:24 user nova-compute[75621]: WARNING nova.compute.manager [req-b8b267e8-6f03-4a48-a840-3eb7a8cbb58f req-29a39daa-0abd-4d6c-86e2-8b73143dd691 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 for instance with vm_state building and task_state spawning.
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-changed-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Refreshing instance network info cache due to event network-changed-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] Acquiring lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Updating instance_info_cache with network_info: [{"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Releasing lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Instance network_info: |[{"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] Acquired lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.neutron [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Refreshing network info cache for port 3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Start _get_guest_xml network_info=[{"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:24 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1127206070',display_name='tempest-VolumesActionsTest-instance-1127206070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1127206070',id=11,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c5a4463276244c1b9138b190e65d9e1',ramdisk_id='',reservation_id='r-eyt710x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1694988353',owner_user_name='tempest-VolumesActionsTest-1694988353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:02:23Z,user_data=None,user_id='d2f1941d34224041bbbfd15a08301b6d',uuid=521810a6-88ad-46c0-b73c-d77f6b26a66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converting VIF {"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.objects.instance [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lazy-loading 'pci_devices' on Instance uuid 521810a6-88ad-46c0-b73c-d77f6b26a66e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:02:24 user nova-compute[75621]:   <uuid>521810a6-88ad-46c0-b73c-d77f6b26a66e</uuid>
Nov 27 23:02:24 user nova-compute[75621]:   <name>instance-0000000b</name>
Nov 27 23:02:24 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:02:24 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:02:24 user nova-compute[75621]:   <metadata>
Nov 27 23:02:24 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:02:24 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:name>tempest-VolumesActionsTest-instance-1127206070</nova:name>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:02:24</nova:creationTime>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:02:24 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:02:24 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:owner>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:user uuid="d2f1941d34224041bbbfd15a08301b6d">tempest-VolumesActionsTest-1694988353-project-member</nova:user>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:project uuid="6c5a4463276244c1b9138b190e65d9e1">tempest-VolumesActionsTest-1694988353</nova:project>
Nov 27 23:02:24 user nova-compute[75621]:       </nova:owner>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:02:24 user nova-compute[75621]:       <nova:ports>
Nov 27 23:02:24 user nova-compute[75621]:         <nova:port uuid="3cadc9ba-5002-4db6-ae38-6fb516f9dfe8">
Nov 27 23:02:24 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 27 23:02:24 user nova-compute[75621]:         </nova:port>
Nov 27 23:02:24 user nova-compute[75621]:       </nova:ports>
Nov 27 23:02:24 user nova-compute[75621]:     </nova:instance>
Nov 27 23:02:24 user nova-compute[75621]:   </metadata>
Nov 27 23:02:24 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:02:24 user nova-compute[75621]:     <system>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="serial">521810a6-88ad-46c0-b73c-d77f6b26a66e</entry>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="uuid">521810a6-88ad-46c0-b73c-d77f6b26a66e</entry>
Nov 27 23:02:24 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:02:24 user nova-compute[75621]:     </system>
Nov 27 23:02:24 user nova-compute[75621]:   </sysinfo>
Nov 27 23:02:24 user nova-compute[75621]:   <os>
Nov 27 23:02:24 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:02:24 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:02:24 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:02:24 user nova-compute[75621]:   </os>
Nov 27 23:02:24 user nova-compute[75621]:   <features>
Nov 27 23:02:24 user nova-compute[75621]:     <acpi/>
Nov 27 23:02:24 user nova-compute[75621]:     <apic/>
Nov 27 23:02:24 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:02:24 user nova-compute[75621]:   </features>
Nov 27 23:02:24 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:02:24 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:02:24 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:02:24 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:02:24 user nova-compute[75621]:   </clock>
Nov 27 23:02:24 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:02:24 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:02:24 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:02:24 user nova-compute[75621]:   </cpu>
Nov 27 23:02:24 user nova-compute[75621]:   <devices>
Nov 27 23:02:24 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:02:24 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:02:24 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk"/>
Nov 27 23:02:24 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:02:24 user nova-compute[75621]:     </disk>
Nov 27 23:02:24 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:02:24 user nova-compute[75621]:       <mac address="fa:16:3e:c1:80:8f"/>
Nov 27 23:02:24 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:24 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:02:24 user nova-compute[75621]:       <target dev="tap3cadc9ba-50"/>
Nov 27 23:02:24 user nova-compute[75621]:     </interface>
Nov 27 23:02:24 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:02:24 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/console.log" append="off"/>
Nov 27 23:02:24 user nova-compute[75621]:     </serial>
Nov 27 23:02:24 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:02:24 user nova-compute[75621]:     <video>
Nov 27 23:02:24 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:02:24 user nova-compute[75621]:     </video>
Nov 27 23:02:24 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:02:24 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:02:24 user nova-compute[75621]:     </rng>
Nov 27 23:02:24 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:02:24 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:02:24 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:02:24 user nova-compute[75621]:     </memballoon>
Nov 27 23:02:24 user nova-compute[75621]:   </devices>
Nov 27 23:02:24 user nova-compute[75621]: </domain>
Nov 27 23:02:24 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1127206070',display_name='tempest-VolumesActionsTest-instance-1127206070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1127206070',id=11,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c5a4463276244c1b9138b190e65d9e1',ramdisk_id='',reservation_id='r-eyt710x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1694988353',owner_user_name='tempest-VolumesActionsTest-1694988353-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:02:23Z,user_data=None,user_id='d2f1941d34224041bbbfd15a08301b6d',uuid=521810a6-88ad-46c0-b73c-d77f6b26a66e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converting VIF {"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG os_vif [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe43f4b8-0b41-5eb5-b490-20f6ebee0719', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cadc9ba-50, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cadc9ba-50, col_values=(('qos', UUID('4c3b90e5-5728-4b81-97b8-f07df1d2c060')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cadc9ba-50, col_values=(('external_ids', {'iface-id': '3cadc9ba-5002-4db6-ae38-6fb516f9dfe8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:80:8f', 'vm-uuid': '521810a6-88ad-46c0-b73c-d77f6b26a66e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: INFO os_vif [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50')
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] No VIF found with MAC fa:16:3e:c1:80:8f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.network.neutron [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Updated VIF entry in instance network info cache for port 3cadc9ba-5002-4db6-ae38-6fb516f9dfe8. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.network.neutron [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Updating instance_info_cache with network_info: [{"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0043e6eb-1b7c-45b7-8120-b6d478475286 req-24733c5f-37bd-406e-825d-7d83cae4471f service nova] Releasing lock "refresh_cache-521810a6-88ad-46c0-b73c-d77f6b26a66e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:25 user nova-compute[75621]: WARNING nova.compute.manager [req-593f08d9-1fb5-4416-8add-ca3f787debc7 req-945da09d-9bdc-46f4-ab33-405fd66b2876 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c for instance with vm_state building and task_state spawning.
Nov 27 23:02:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-4a6a3b11-b7e3-456f-823b-79fe9c4052cd req-4e3e892f-f730-430a-a094-33617da69901 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:26 user nova-compute[75621]: WARNING nova.compute.manager [req-5266419b-9de2-4305-98c1-46a327df8aa3 req-baadcd7d-e4aa-4742-90bb-9f2d36c0280c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 for instance with vm_state building and task_state spawning.
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:27 user nova-compute[75621]: WARNING nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c for instance with vm_state building and task_state spawning.
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:27 user nova-compute[75621]: WARNING nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 for instance with vm_state building and task_state spawning.
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:27 user nova-compute[75621]: WARNING nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 for instance with vm_state building and task_state spawning.
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:27 user nova-compute[75621]: WARNING nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 for instance with vm_state building and task_state spawning.
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:27 user nova-compute[75621]: WARNING nova.compute.manager [req-af9714b3-83eb-4bf9-b134-e8cd6e72fd78 req-5d8e0cfb-4151-44d3-b20b-070b238b2269 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 for instance with vm_state building and task_state spawning.
Nov 27 23:02:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] No waiting events found dispatching network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:28 user nova-compute[75621]: WARNING nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received unexpected event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 for instance with vm_state building and task_state spawning.
Nov 27 23:02:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] No waiting events found dispatching network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:28 user nova-compute[75621]: WARNING nova.compute.manager [req-ab3989ec-b332-485f-baaf-4a17eb4f09dd req-263fd888-ea83-4033-a9db-b9dbf371192d service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received unexpected event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 for instance with vm_state building and task_state spawning.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Instance spawned successfully.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance spawned successfully.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Took 6.11 seconds to spawn the instance on the hypervisor.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Took 12.30 seconds to spawn the instance on the hypervisor.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.compute.manager [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Took 6.84 seconds to build instance.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-18031a72-3994-459f-9265-efcc3c47573b tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.937s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:29 user nova-compute[75621]: INFO nova.compute.manager [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Took 36.87 seconds to build instance.
Nov 27 23:02:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8d4540cc-16d5-4ea7-a401-c6d7fc124b01 tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.089s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lazy-loading 'flavor' on Instance uuid 7d493459-5f13-4636-af59-35825af940e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:39 user nova-compute[75621]: INFO nova.compute.manager [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Attaching volume 4519f8e3-e0bd-4457-8c27-8366320c8bcb to /dev/vdb
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.utils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2028719-ae3c-4218-8b60-46a685142cab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844c1e8-d4f2-4792-b2be-79c9b052ab41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6232614-e0bf-423a-bd08-e6b100df503e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf4eae1-9b48-4da7-b451-2587b9585c23]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:39 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:02:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1dd830-6c84-4541-8f6b-def6e975ad04]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG os_brick.utils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:39 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updating existing volume attachment record: 756e6da9-84a1-4dbc-9aeb-29689d028f71 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:02:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-changed-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Refreshing instance network info cache due to event network-changed-37e89c03-0357-46ad-9765-d16725a8dca6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG nova.network.neutron [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Refreshing network info cache for port 37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:43 user nova-compute[75621]: DEBUG nova.network.neutron [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updated VIF entry in instance network info cache for port 37e89c03-0357-46ad-9765-d16725a8dca6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:43 user nova-compute[75621]: DEBUG nova.network.neutron [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0b337e16-0d44-486b-a5aa-808d79ba3ec3 req-90538cf1-e71f-4a8a-a2ad-07637d986fa9 service nova] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:02:44 user nova-compute[75621]: INFO nova.compute.manager [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] instance snapshotting
Nov 27 23:02:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Beginning live snapshot process
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.457s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-changed-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Refreshing instance network info cache due to event network-changed-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Refreshing network info cache for port 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d.delta 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d.delta 1073741824" returned: 0 in 0.082s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75621) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Nov 27 23:02:45 user nova-compute[75621]: INFO nova.virt.libvirt.host [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] UEFI support detected
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updated VIF entry in instance network info cache for port 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f689c85-7352-43a9-854b-2b1da2b6bafa req-feca1c00-d9c2-426c-9968-7681f6e111da service nova] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:02:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing instance network info cache due to event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 16646144 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json" returned: 0 in 0.355s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:02:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated VIF entry in instance network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d.delta /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7725daf7-c963-4b85-8e01-516e5e6a19f5 req-fc2bd275-d32b-4140-b838-a551f84132fe service nova] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGcoNpHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:47 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:47 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:47 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3833c3-cf97-4823-bda7-5f96ea3f2d7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:02:47 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ef665f-fca4-427b-8ce9-84efc0580e2d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb] added
Nov 27 23:02:47 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948979e-82ec-4604-ade3-1af44d8f9441]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5d50df-3b20-4f9b-8987-109fccf0567e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGcoNpHE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YGcoNpHE" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa559c13-331e-4e48-88ed-1c7f80dbab97]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YGcoNpHE'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3749ffa-112e-4cde-b545-1ca70eb017e4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7df425-9860-4f5b-bc7a-6598314fe5b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d.delta /opt/stack/data/nova/instances/snapshots/tmpu7rksc0t/9501accb53754b21bab14ae71bc9670d" returned: 0 in 0.713s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Snapshot extracted, beginning image upload
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:49 user nova-compute[75621]: INFO nova.compute.manager [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Attaching volume 50bfd854-7ced-465f-9682-753bb197abe2 to /dev/vdb
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.utils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec901d36-f7cc-4e6e-b8d0-08c48f69b018]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4deec6a6-fa32-48a3-a217-5a8fbced6d73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7199adf7-545b-4aeb-808d-b3f099a67d9c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d824c1-70ef-4ec2-a0d0-79cac8fa001e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:02:49 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d60db0-8a68-49b9-a714-2a3ea13524cb]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.utils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating existing volume attachment record: 422cfe61-6f56-4d2e-98d7-41f5ccd0703f {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --login" returned: 0 in 1.099s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80418a80-26cd-4cb8-858f-c1171dee42cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260]
Nov 27 23:02:49 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05915ac5-bbe0-4b12-bf00-1474f2f548dc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0768177b-e67d-43f0-b181-e5374fef14c5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)
Nov 27 23:02:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:49 user nova-compute[75621]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)
Nov 27 23:02:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.545s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbf20ae-7391-4fb2-9f9e-0bbd906f52c2]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGcoNpHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.623s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] <== connect_volume: return (2627ms) {'type': 'block', 'scsi_wwn': '23765366230616264', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765366230616264', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lazy-loading 'flavor' on Instance uuid 7d493459-5f13-4636-af59-35825af940e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:02:50 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:02:50 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:02:50 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:02:50 user nova-compute[75621]:   <serial>4519f8e3-e0bd-4457-8c27-8366320c8bcb</serial>
Nov 27 23:02:50 user nova-compute[75621]: </disk>
Nov 27 23:02:50 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] No VIF found with MAC fa:16:3e:20:12:1a, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-587dbcbd-921b-43a1-a8e8-b07244b1fd11 tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.429s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:02:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Snapshot image upload complete
Nov 27 23:02:51 user nova-compute[75621]: INFO nova.compute.manager [None req-d867228c-1fe9-464e-b225-bef2aab3d813 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Took 7.28 seconds to snapshot the instance on the hypervisor.
Nov 27 23:02:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.383926391601562GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.005s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7d493459-5f13-4636-af59-35825af940e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5875141e-b743-4f59-a26d-b35226c182e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f4db7063-348e-4c7a-97d9-1b014e453e39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance dfdff3c7-4ea4-4c11-a737-71c46c844fce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 02b2be65-783d-4d2d-a968-5cfd3f62ef1e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 521810a6-88ad-46c0-b73c-d77f6b26a66e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:02:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:52 user nova-compute[75621]: INFO nova.compute.manager [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Terminating instance
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-unplugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] No waiting events found dispatching network-vif-unplugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-1d1243cd-831c-4bfb-bcfe-dafa554ef452 req-3843a2cb-19a3-4f8a-89f4-5d7d4355ed40 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-unplugged-4182e86e-d05e-4f90-bef4-bf7979644e49 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.550s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] Instance destroyed successfully.
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lazy-loading 'resources' on Instance uuid 7d493459-5f13-4636-af59-35825af940e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1706753872',display_name='tempest-DeleteServersTestJSON-server-1706753872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1706753872',id=1,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c56e5376240c4933a75d2962d3ea0d8f',ramdisk_id='',reservation_id='r-6jiyrs20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-495956292',owner_user_name='tempest-DeleteServersTestJSON-495956292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:06Z,user_data=None,user_id='5d1fa967559449abaf467360c3e33e86',uuid=7d493459-5f13-4636-af59-35825af940e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converting VIF {"id": "4182e86e-d05e-4f90-bef4-bf7979644e49", "address": "fa:16:3e:20:12:1a", "network": {"id": "f0e066c0-cb70-43b6-82e2-b5f0d6c5788a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1793284817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c56e5376240c4933a75d2962d3ea0d8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4182e86e-d0", "ovs_interfaceid": "4182e86e-d05e-4f90-bef4-bf7979644e49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_vif [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4182e86e-d0, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0b79463-c5d8-4423-8cfa-c33c2e6e5872) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:02:52 user nova-compute[75621]: INFO os_vif [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:12:1a,bridge_name='br-int',has_traffic_filtering=True,id=4182e86e-d05e-4f90-bef4-bf7979644e49,network=Network(f0e066c0-cb70-43b6-82e2-b5f0d6c5788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4182e86e-d0')
Nov 27 23:02:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YGcoNpHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d49bc-f323-4837-b564-0d650b4ee11d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:02:52 user nova-compute[75621]: No targets found.
Nov 27 23:02:52 user nova-compute[75621]: iSNS:
Nov 27 23:02:52 user nova-compute[75621]: No targets found.
Nov 27 23:02:52 user nova-compute[75621]: STATIC:
Nov 27 23:02:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb
Nov 27 23:02:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:02:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:02:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:02:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:02:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:02:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:02:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:02:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:02:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466
Nov 27 23:02:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:02:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:02:52 user nova-compute[75621]: FIRMWARE:
Nov 27 23:02:52 user nova-compute[75621]: No targets found.
Nov 27 23:02:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:02:52 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:02:52 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa4c1de-249e-44d3-869f-f7221b8f7652]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e46715-417f-4f64-85dd-262673cfd91f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)
Nov 27 23:02:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:52 user nova-compute[75621]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb (non-flash)
Nov 27 23:02:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13000f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e1002-0e81-45f8-b773-95ebf9a889e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa714a6e-041e-49b7-be1e-abec8c86446d]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c704a0-ca0a-41a7-bf7e-59c83d707253]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:02:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.032s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9bff92-2927-4ab7-980e-a9c48bc14242]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[114472e6-3c6f-4abe-897e-eb13c751f56b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e681a7-1ffc-4514-a35f-9066dc5a9dba]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260]
Nov 27 23:02:53 user nova-compute[75621]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4519f8e3-e0bd-4457-8c27-8366320c8bcb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[01541e9a-e5a7-4734-b9ee-c66b802cbc9f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] <== disconnect_volume: return (296ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:02:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Deleting instance files /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9_del
Nov 27 23:02:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Deletion of /opt/stack/data/nova/instances/7d493459-5f13-4636-af59-35825af940e9_del complete
Nov 27 23:02:53 user nova-compute[75621]: INFO nova.compute.manager [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 27 23:02:53 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:02:53 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:02:54 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 7d493459-5f13-4636-af59-35825af940e9] Took 0.90 seconds to deallocate network for instance.
Nov 27 23:02:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-f092aab0-9c30-4cb7-9df9-e8fa460bf477 req-70e3fd93-0e5b-4929-a768-f501e2488655 service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-deleted-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] Acquiring lock "7d493459-5f13-4636-af59-35825af940e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] Lock "7d493459-5f13-4636-af59-35825af940e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] No waiting events found dispatching network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:54 user nova-compute[75621]: WARNING nova.compute.manager [req-be463a9d-be86-428c-9a40-fc7d684a4217 req-fe0e7d10-c336-4bba-a4a5-717c3af07d2a service nova] [instance: 7d493459-5f13-4636-af59-35825af940e9] Received unexpected event network-vif-plugged-4182e86e-d05e-4f90-bef4-bf7979644e49 for instance with vm_state active and task_state deleting.
Nov 27 23:02:54 user nova-compute[75621]: INFO nova.compute.manager [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] [instance: 7d493459-5f13-4636-af59-35825af940e9] Took 0.81 seconds to detach 1 volumes for instance.
Nov 27 23:02:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:55 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:02:55 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:02:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:55 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Deleted allocations for instance 7d493459-5f13-4636-af59-35825af940e9
Nov 27 23:02:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c30911d-0919-4f74-9c28-cac8ee86273e tempest-DeleteServersTestJSON-495956292 tempest-DeleteServersTestJSON-495956292-project-member] Lock "7d493459-5f13-4636-af59-35825af940e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.432s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:02:56 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:56 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:02:56 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96bbefa-7d0e-4bee-a803-72ccf93ff71a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:02:56 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4fb3ea-6566-40e7-b846-682371455ec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2] added
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a801d1-5e2c-46b3-b25b-25bfbfa5dcb2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c634eb-c30e-496e-b4cf-b1606d4f99d2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtoUZwnR {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtoUZwnR" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0510b2-4054-4b1e-94ae-c5f32eda9929]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtoUZwnR'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd69df55-8d02-4b09-af2a-ec89eb4f1e3c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9e8bf-c041-4511-bd0e-971b16c9e325]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[903de506-ee66-4fce-ad7c-648930809743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]
Nov 27 23:02:56 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[490958f9-5afe-4924-ac1b-4623156ba863]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06230bf-553a-462d-869e-3246c978875f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:02:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd0166a-ba28-4d94-b6ba-c4787814120e]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:02:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23061376536613730', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061376536613730', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:02:57 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:02:57 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:02:57 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:02:57 user nova-compute[75621]:   <serial>50bfd854-7ced-465f-9682-753bb197abe2</serial>
Nov 27 23:02:57 user nova-compute[75621]: </disk>
Nov 27 23:02:57 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No VIF found with MAC fa:16:3e:0e:a3:79, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a118250f-e279-41a1-b47a-c829d8d009b9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.431s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75621) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:02:59 user nova-compute[75621]: WARNING nova.compute.manager [req-154e5196-c108-4efe-bbed-57e3fd282292 req-4d18c487-9f69-46c9-ac63-7bf34a89aae4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state active and task_state powering-off.
Nov 27 23:02:59 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance destroyed successfully.
Nov 27 23:02:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:02:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9be83d02-48bf-4228-96a1-63621b8ea268 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.859s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:01 user nova-compute[75621]: WARNING nova.compute.manager [req-abc53f01-5c57-45e4-b9f5-0959927cbc4c req-e040b63b-cbb4-4929-9586-a999628aa6e4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state None.
Nov 27 23:03:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-changed-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Refreshing instance network info cache due to event network-changed-47e511ef-668a-4ed7-9e49-ccb3719723a5. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] Acquiring lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] Acquired lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Refreshing network info cache for port 47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-changed-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Refreshing instance network info cache due to event network-changed-d340b0c4-29e1-4243-a87b-92171c11212e. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] Acquiring lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] Acquired lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Refreshing network info cache for port d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updated VIF entry in instance network info cache for port d340b0c4-29e1-4243-a87b-92171c11212e. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating instance_info_cache with network_info: [{"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-74062c18-79ce-4df6-a322-1d2684a5a0fa req-53e55be3-2e4e-4021-93a4-9e06de0dfe48 service nova] Releasing lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updated VIF entry in instance network info cache for port 47e511ef-668a-4ed7-9e49-ccb3719723a5. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updating instance_info_cache with network_info: [{"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d02bc914-ccfb-4a4b-9ddd-08f58fdd1deb req-0e12ca11-b610-4077-9ae4-e1e0c95d9b28 service nova] Releasing lock "refresh_cache-5875141e-b743-4f59-a26d-b35226c182e0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-changed-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing instance network info cache due to event network-changed-d06cc534-9b80-4b4a-98b6-7e45fc79b89d. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing network info cache for port d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updated VIF entry in instance network info cache for port d06cc534-9b80-4b4a-98b6-7e45fc79b89d. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0825cbe-6449-4071-9d31-1e8a261491a1 req-c3c796f6-9e46-4874-9362-0a827085bec0 service nova] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lazy-loading 'flavor' on Instance uuid 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'flavor' on Instance uuid 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'pci_requests' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Object Instance<f4db7063-348e-4c7a-97d9-1b014e453e39> lazy-loaded attributes: flavor,pci_requests {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.network.neutron [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:07 user nova-compute[75621]: INFO nova.compute.manager [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Attaching volume d4435766-9313-498b-b259-fc24d1170a53 to /dev/sdc
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:07 user nova-compute[75621]: INFO nova.compute.manager [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Attaching volume 1a26b734-9cba-451c-8954-b5ea9754e5c5 to /dev/vdb
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.policy [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '933ec913fbde47aa90a41d1e7d74d99d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '301d1c9794924637ba360f1c18ffc585', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c21556-214f-4d50-9f1c-ff0870e18b40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d038caf7-ba27-4eef-91cb-43798c5b6da6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[66057eac-a3a4-4c49-a95f-b03dce01bafb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfee44-7bc8-409f-982c-c7db8c0c28ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[880c96b7-3f5d-49d5-8b83-2479e25929c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[75daaf42-46a1-4375-b900-3c925533d12c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:07 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bda2ec7-1f42-4434-8c75-d10f85a0a076]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updating existing volume attachment record: 2f4cdbe7-434d-403e-aa77-ef98af2d400b {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[891289fd-ad98-487f-b9d4-c3252b183378]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0218989b-c6fb-4d8e-8bfa-32859478f306]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:07 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:03:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd06fade-a333-4b61-8066-28d1019a9fb0]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating existing volume attachment record: 8617d5d6-64ef-4c17-b3b5-0aeaaf19d740 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Successfully created port: 0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Successfully updated port: 0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-changed-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing instance network info cache due to event network-changed-0a6e2f35-0ea4-4277-add6-1f73f45bee02. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Refreshing network info cache for port 0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG os_vif [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b2661bc-6b4b-5447-bc3a-b17d28253d9e', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a6e2f35-0e, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a6e2f35-0e, col_values=(('qos', UUID('efd66fa9-1a99-4af9-a80b-2c1258ed6d74')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a6e2f35-0e, col_values=(('external_ids', {'iface-id': '0a6e2f35-0ea4-4277-add6-1f73f45bee02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:71:b8', 'vm-uuid': 'f4db7063-348e-4c7a-97d9-1b014e453e39'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: INFO os_vif [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e')
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] attach device xml: <interface type="ethernet">
Nov 27 23:03:09 user nova-compute[75621]:   <mac address="fa:16:3e:8c:71:b8"/>
Nov 27 23:03:09 user nova-compute[75621]:   <model type="virtio"/>
Nov 27 23:03:09 user nova-compute[75621]:   <mtu size="1442"/>
Nov 27 23:03:09 user nova-compute[75621]:   <target dev="tap0a6e2f35-0e"/>
Nov 27 23:03:09 user nova-compute[75621]: </interface>
Nov 27 23:03:09 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updated VIF entry in instance network info cache for port 0a6e2f35-0ea4-4277-add6-1f73f45bee02. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0842e68d-cc54-458b-8672-916de7c0311f req-a7091010-916e-432b-8cf1-f05f9706d94e service nova] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:09 user nova-compute[75621]: WARNING nova.compute.manager [req-124d6a8b-ed41-48df-ab35-1932cf5c94e3 req-fc08803a-bf6c-47ad-aaee-351fb1ed2ca8 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 for instance with vm_state active and task_state None.
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name hda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No VIF found with MAC fa:16:3e:fe:7a:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:03:10 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:03:10</nova:creationTime>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:03:10 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:03:10 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:owner>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:03:10 user nova-compute[75621]:   </nova:owner>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:03:10 user nova-compute[75621]:   <nova:ports>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:03:10 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:03:10 user nova-compute[75621]:     </nova:port>
Nov 27 23:03:10 user nova-compute[75621]:     <nova:port uuid="0a6e2f35-0ea4-4277-add6-1f73f45bee02">
Nov 27 23:03:10 user nova-compute[75621]:       <nova:ip type="fixed" address="10.10.10.3" ipVersion="4"/>
Nov 27 23:03:10 user nova-compute[75621]:     </nova:port>
Nov 27 23:03:10 user nova-compute[75621]:   </nova:ports>
Nov 27 23:03:10 user nova-compute[75621]: </nova:instance>
Nov 27 23:03:10 user nova-compute[75621]:  {{(pid=75621) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-508d3226-002f-4061-90b7-6d0ef84ed41d tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.719s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:10 user nova-compute[75621]: INFO nova.compute.manager [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Attaching volume 4dfeca57-be14-4b9f-9f42-465b2b181735 to /dev/vdb
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee760ab-6f01-46f6-bc27-7c3d95dab610]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6caa5e-be1b-478d-979e-21f5456fae24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32a1f16-1059-4ec5-a42d-ce06a3ca7560]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[846842fc-4bc7-4556-9a5f-db698e38910a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:10 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:03:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c64cab-fc2a-4b1d-93d1-8286c838573e]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:10 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating existing volume attachment record: a9bc48cf-a6ac-464e-a3c7-5740cc75d1fe {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:03:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:11 user nova-compute[75621]: WARNING nova.compute.manager [req-03dd1c33-531b-4b2d-81a0-155272d9c0ea req-40591043-9690-4069-a1a9-cbcae7521194 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 for instance with vm_state active and task_state None.
Nov 27 23:03:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELlBnmUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:14 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:14 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:14 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[466eaa9d-5ba5-4309-a5bc-f80ae0e2464d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:03:14 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12040c8-3256-4dc4-8981-832bb15640bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53] added
Nov 27 23:03:14 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dabfdc1-edde-48e3-b7f1-7552dc736c36]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328bbb3-5f26-4c60-892f-5f1b2160defe]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELlBnmUO {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ELlBnmUO" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01dbc9b-97c3-45b8-be31-ddeedceb06f8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ELlBnmUO'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6919ae8-ee35-4ac1-9b73-c6c8775497a1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80226f48-122b-4809-ad84-888c657f0a68]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbe9f57-7897-4f2e-a54d-8e5c53f4eba9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260]
Nov 27 23:03:15 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4229985-59e6-4104-b892-6b9afd1b54f3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[43806f82-166a-4497-96df-2211dd3f5de9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49114c14-ae67-42db-9550-1d79de345446]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELlBnmUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23832366561346364', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832366561346364', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lazy-loading 'flavor' on Instance uuid 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:03:16 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:16 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:03:16 user nova-compute[75621]:   <target dev="sdc" bus="scsi"/>
Nov 27 23:03:16 user nova-compute[75621]:   <serial>d4435766-9313-498b-b259-fc24d1170a53</serial>
Nov 27 23:03:16 user nova-compute[75621]:   <address type="drive" controller="0" unit="2"/>
Nov 27 23:03:16 user nova-compute[75621]: </disk>
Nov 27 23:03:16 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No BDM found with device name sda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] No VIF found with MAC fa:16:3e:d9:e4:db, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:03:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb3fdb06-0861-46bd-905b-c4578953dba2 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.386s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:17 user nova-compute[75621]: INFO nova.compute.manager [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Detaching volume d4435766-9313-498b-b259-fc24d1170a53
Nov 27 23:03:17 user nova-compute[75621]: INFO nova.virt.block_device [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Attempting to driver detach volume d4435766-9313-498b-b259-fc24d1170a53 from mountpoint /dev/sdc
Nov 27 23:03:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Attempting to detach device sdc from instance 5875141e-b743-4f59-a26d-b35226c182e0 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:03:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:17 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:17 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:03:17 user nova-compute[75621]:   <target dev="sdc" bus="scsi"/>
Nov 27 23:03:17 user nova-compute[75621]:   <serial>d4435766-9313-498b-b259-fc24d1170a53</serial>
Nov 27 23:03:17 user nova-compute[75621]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 23:03:17 user nova-compute[75621]: </disk>
Nov 27 23:03:17 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Successfully detached device sdc from instance 5875141e-b743-4f59-a26d-b35226c182e0 from the persistent domain config.
Nov 27 23:03:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 5875141e-b743-4f59-a26d-b35226c182e0 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:03:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:17 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:17 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:03:17 user nova-compute[75621]:   <target dev="sdc" bus="scsi"/>
Nov 27 23:03:17 user nova-compute[75621]:   <serial>d4435766-9313-498b-b259-fc24d1170a53</serial>
Nov 27 23:03:17 user nova-compute[75621]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 27 23:03:17 user nova-compute[75621]: </disk>
Nov 27 23:03:17 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:03:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-changed-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Refreshing instance network info cache due to event network-changed-de498b21-1fbc-4b3c-946c-4a1e5de6d392. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] Acquiring lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] Acquired lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Refreshing network info cache for port de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lazy-loading 'flavor' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updated VIF entry in instance network info cache for port de498b21-1fbc-4b3c-946c-4a1e5de6d392. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updating instance_info_cache with network_info: [{"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6dbd3c2-1077-486d-943f-b2c6e9e8414b req-86284231-a2a3-4ecf-895c-57b22c1356ec service nova] Releasing lock "refresh_cache-dfdff3c7-4ea4-4c11-a737-71c46c844fce" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:21 user nova-compute[75621]: INFO nova.compute.manager [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Attaching volume 9780afcd-f066-4d2f-a396-1cbd8346c97d to /dev/vdb
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.utils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[172d3d3c-5c93-4cc6-a285-ac37906c44ad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9d604-8134-439f-8506-cd6f54d50e82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08774083-d96b-4ff0-93c2-1334831c5375]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cee502-96ce-41a1-95a3-4364591220d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:03:21 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:03:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[14849d2a-2def-47f0-b368-0f717f6da41a]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.utils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updating existing volume attachment record: 22d16d3f-c600-4fe7-a6e6-1683fcba0111 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPkjKYCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:21 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:22 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:22 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3770315b-fe62-485a-ab18-eb19786a4a5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:03:22 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bc5032-c38c-47b5-8127-814fc6ec9a5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5] added
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpXCduoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:22 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e11933-2284-4f5c-bc0e-21ba48511009]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[18982fc4-737f-4ade-9224-830400275953]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPkjKYCg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VPkjKYCg" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db2cbf5-8e9e-45f6-9a06-590f9bca43a5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VPkjKYCg'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d27767-bd41-44b8-b4b4-46cb2865b8e1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a53073b-197a-4a08-adee-0b997187dd1d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78521df-2733-4a2a-8463-5c310ce1423d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260]
Nov 27 23:03:22 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c525af55-a22b-4377-aee2-ba7ce38a3cbd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[375ce372-2308-4e15-956b-b31b417833f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a376a5-b165-412c-af8a-ec7f08de8063]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPkjKYCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23436393534363231', 'path': '/dev/sdg'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393534363231', 'path': '/dev/sdg'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.277s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:23 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:23 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'flavor' on Instance uuid 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[be054747-548b-46a8-8a9f-1d1d8239f1fe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:03:23 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:03:23 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:23 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:03:23 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:23 user nova-compute[75621]:   <serial>1a26b734-9cba-451c-8954-b5ea9754e5c5</serial>
Nov 27 23:03:23 user nova-compute[75621]: </disk>
Nov 27 23:03:23 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110c018-0ba8-49f5-92d6-246c7d39097c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735] added
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[896d738a-f931-4e77-a2bf-d9b2e4ed9e27]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[936ba4fa-4366-43fe-a1d0-1dca2a7075e7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpXCduoh {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fpXCduoh" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1155233-a560-41da-997f-9bd15e68060a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fpXCduoh'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5836a52b-1fc9-4010-9017-b944065e54ac]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddd1d78-b2de-4178-9631-aab47824281c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[67258734-16c3-499c-b374-994fa09f20d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260]
Nov 27 23:03:23 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6950ce2-cbec-43d1-86fe-e08a223b6c3d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7838b8d9-8268-430c-be3f-0d24d5f2a103]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:23 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f43a3e8-481e-4f43-9b1b-c673005802dd]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpXCduoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No VIF found with MAC fa:16:3e:1e:bc:3e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:03:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-937a7f69-71af-49b8-8fef-9b7d41aa56fd tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.322s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] <== connect_volume: return (2631ms) {'type': 'block', 'scsi_wwn': '23630636234663931', 'path': '/dev/sdh'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630636234663931', 'path': '/dev/sdh'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG nova.objects.instance [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:03:24 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:24 user nova-compute[75621]:   <source dev="/dev/sdh"/>
Nov 27 23:03:24 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:24 user nova-compute[75621]:   <serial>4dfeca57-be14-4b9f-9f42-465b2b181735</serial>
Nov 27 23:03:24 user nova-compute[75621]: </disk>
Nov 27 23:03:24 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No BDM found with device name hda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] No VIF found with MAC fa:16:3e:fe:7a:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7971e3b7-62c9-4fd0-9724-38e1ca3405d6 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.652s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:25 user nova-compute[75621]: INFO nova.compute.manager [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Detaching volume 1a26b734-9cba-451c-8954-b5ea9754e5c5
Nov 27 23:03:25 user nova-compute[75621]: INFO nova.virt.block_device [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Attempting to driver detach volume 1a26b734-9cba-451c-8954-b5ea9754e5c5 from mountpoint /dev/vdb
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Attempting to detach device vdb from instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:25 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:03:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:25 user nova-compute[75621]:   <serial>1a26b734-9cba-451c-8954-b5ea9754e5c5</serial>
Nov 27 23:03:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:03:25 user nova-compute[75621]: </disk>
Nov 27 23:03:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:25 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully detached device vdb from instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f from the persistent domain config.
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:25 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:03:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:25 user nova-compute[75621]:   <serial>1a26b734-9cba-451c-8954-b5ea9754e5c5</serial>
Nov 27 23:03:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:03:25 user nova-compute[75621]: </disk>
Nov 27 23:03:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:03:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:26 user nova-compute[75621]: INFO nova.compute.manager [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Detaching volume 4dfeca57-be14-4b9f-9f42-465b2b181735
Nov 27 23:03:26 user nova-compute[75621]: INFO nova.virt.block_device [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Attempting to driver detach volume 4dfeca57-be14-4b9f-9f42-465b2b181735 from mountpoint /dev/vdb
Nov 27 23:03:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Attempting to detach device vdb from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:03:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:26 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:26 user nova-compute[75621]:   <source dev="/dev/sdh"/>
Nov 27 23:03:26 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:26 user nova-compute[75621]:   <serial>4dfeca57-be14-4b9f-9f42-465b2b181735</serial>
Nov 27 23:03:26 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:03:26 user nova-compute[75621]: </disk>
Nov 27 23:03:26 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:26 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully detached device vdb from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the persistent domain config.
Nov 27 23:03:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:03:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:26 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:26 user nova-compute[75621]:   <source dev="/dev/sdh"/>
Nov 27 23:03:26 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:26 user nova-compute[75621]:   <serial>4dfeca57-be14-4b9f-9f42-465b2b181735</serial>
Nov 27 23:03:26 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:03:26 user nova-compute[75621]: </disk>
Nov 27 23:03:26 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:03:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKPNqjyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:29 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:29 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:29 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e9980b-01a2-442e-aa20-f28d0d1bb594]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:03:29 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b2b662-6b86-4f9b-b3bb-5e6572dc78e1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d] added
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb76b07-ea02-4e14-85b9-b992e7efd939]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f544fd-76ac-4956-9761-527c5f8c8c43]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKPNqjyU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKPNqjyU" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1124f68d-8a2e-43c2-a869-43fb1a76584a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xKPNqjyU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86949642-a48d-4b5f-982f-d7eede64b0a7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[227352cb-d2f9-4761-9d42-49982164a7f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51815e2d-7b85-4e55-9d58-636ebafac808]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260]
Nov 27 23:03:29 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ab004-22ec-4184-88fb-47b36cf3d623]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ffd4b-6df0-4a17-a6bf-0e64f70cf8d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f068b2-77b0-453c-b27e-f8078537026d]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKPNqjyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23837646137316130', 'path': '/dev/sdi'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837646137316130', 'path': '/dev/sdi'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.objects.instance [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lazy-loading 'flavor' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] attach device xml: <disk type="block" device="disk">
Nov 27 23:03:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:30 user nova-compute[75621]:   <source dev="/dev/sdi"/>
Nov 27 23:03:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:30 user nova-compute[75621]:   <serial>9780afcd-f066-4d2f-a396-1cbd8346c97d</serial>
Nov 27 23:03:30 user nova-compute[75621]: </disk>
Nov 27 23:03:30 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] No VIF found with MAC fa:16:3e:05:dd:4f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:03:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-94620119-2061-4c34-b507-25fb28aae8da tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.584s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] volume_snapshot_create: create_info: {'snapshot_id': '406d993e-1754-40c0-846f-205a6aab82be', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75621) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] snap xml: <domainsnapshot>
Nov 27 23:03:31 user nova-compute[75621]:   <disks>
Nov 27 23:03:31 user nova-compute[75621]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 27 23:03:31 user nova-compute[75621]:       <source file="/dev/new_file"/>
Nov 27 23:03:31 user nova-compute[75621]:     </disk>
Nov 27 23:03:31 user nova-compute[75621]:     <disk name="vda" snapshot="no"/>
Nov 27 23:03:31 user nova-compute[75621]:   </disks>
Nov 27 23:03:31 user nova-compute[75621]: </domainsnapshot>
Nov 27 23:03:31 user nova-compute[75621]:  {{(pid=75621) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] Lazy-loading 'system_metadata' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:31 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     rv = execute(f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     six.reraise(c, e, tb)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     raise value
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     rv = meth(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     self._volume_snapshot_create(context, instance, guest,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     rv = execute(f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     six.reraise(c, e, tb)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     raise value
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     rv = meth(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] 
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-33e98346-d4d3-4730-83dd-402713e10f8d tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] volume_snapshot_delete: delete_info: {'volume_id': '9780afcd-f066-4d2f-a396-1cbd8346c97d'} {{(pid=75621) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [None req-33e98346-d4d3-4730-83dd-402713e10f8d tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce]     if delete_info['type'] != 'qcow2':
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] KeyError: 'type'
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 406d993e-1754-40c0-846f-205a6aab82be could not be found.
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise value
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 406d993e-1754-40c0-846f-205a6aab82be could not be found. (HTTP 404) (Request-ID: req-357ddc9a-627a-48d3-8897-354f87c68116)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 406d993e-1754-40c0-846f-205a6aab82be could not be found.
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server [None req-b0e43472-c303-4fd2-a8b7-fd0f99455bd2 tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise value
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver [None req-33e98346-d4d3-4730-83dd-402713e10f8d tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d5e8e2f7-edb8-498f-9b3f-0d1543f0cce3)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 27 23:03:31 user nova-compute[75621]: ERROR nova.virt.libvirt.driver 
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server [None req-33e98346-d4d3-4730-83dd-402713e10f8d tempest-VolumesAssistedSnapshotsTest-828029462 tempest-VolumesAssistedSnapshotsTest-828029462-project] Exception during message handling: KeyError: 'type'
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 27 23:03:31 user nova-compute[75621]: ERROR oslo_messaging.rpc.server 
Nov 27 23:03:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:31 user nova-compute[75621]: INFO nova.compute.manager [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Detaching volume 9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:31 user nova-compute[75621]: INFO nova.virt.block_device [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Attempting to driver detach volume 9780afcd-f066-4d2f-a396-1cbd8346c97d from mountpoint /dev/vdb
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Attempting to detach device vdb from instance dfdff3c7-4ea4-4c11-a737-71c46c844fce from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:31 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:31 user nova-compute[75621]:   <source dev="/dev/sdi"/>
Nov 27 23:03:31 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:31 user nova-compute[75621]:   <serial>9780afcd-f066-4d2f-a396-1cbd8346c97d</serial>
Nov 27 23:03:31 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:03:31 user nova-compute[75621]: </disk>
Nov 27 23:03:31 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:31 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Successfully detached device vdb from instance dfdff3c7-4ea4-4c11-a737-71c46c844fce from the persistent domain config.
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dfdff3c7-4ea4-4c11-a737-71c46c844fce from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:03:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] detach device xml: <disk type="block" device="disk">
Nov 27 23:03:31 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:03:31 user nova-compute[75621]:   <source dev="/dev/sdi"/>
Nov 27 23:03:31 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:03:31 user nova-compute[75621]:   <serial>9780afcd-f066-4d2f-a396-1cbd8346c97d</serial>
Nov 27 23:03:31 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:03:31 user nova-compute[75621]: </disk>
Nov 27 23:03:31 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:03:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 5875141e-b743-4f59-a26d-b35226c182e0 is timed out.
Nov 27 23:03:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Successfully detached device sdc from instance 5875141e-b743-4f59-a26d-b35226c182e0 from the live domain config.
Nov 27 23:03:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ELlBnmUO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:38 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95b267c-7eb4-44f1-b2bd-ac310a4dcf95]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:38 user nova-compute[75621]: No targets found.
Nov 27 23:03:38 user nova-compute[75621]: iSNS:
Nov 27 23:03:38 user nova-compute[75621]: No targets found.
Nov 27 23:03:38 user nova-compute[75621]: STATIC:
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53
Nov 27 23:03:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:38 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:38 user nova-compute[75621]: No targets found.
Nov 27 23:03:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:38 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:38 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd26b20-f6da-4c93-b381-e6801be460c4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78966bda-e6b4-439d-a733-102dfcfc5c5b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1300744310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc76d2-ac49-42e3-ba88-0f5ad25bfe75]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce63a021-69ed-4a30-8bb0-cce5c5f3fb75]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb94cd2-df6b-464f-b38a-14f5a94994df]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe0bfd-f79c-4d20-a0fd-002a7c255daa]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8728ceaf-d517-46cb-9a2e-8d25c1c307fd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2c30ae-48ff-4340-878c-16da5330adaa]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260]
Nov 27 23:03:38 user nova-compute[75621]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4435766-9313-498b-b259-fc24d1170a53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e02b26-659d-49ca-8722-2db053845615]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] <== disconnect_volume: return (356ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lazy-loading 'flavor' on Instance uuid 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f655de0c-e9dc-487f-9673-6bd7f6ca5d48 tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:40 user nova-compute[75621]: INFO nova.compute.manager [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Terminating instance
Nov 27 23:03:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-unplugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] No waiting events found dispatching network-vif-unplugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-50bc0482-01ad-471e-91a3-251a4bd1f39b req-c5779d4d-9322-453a-b121-2a75caf47dcd service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-unplugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Instance destroyed successfully.
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lazy-loading 'resources' on Instance uuid 5875141e-b743-4f59-a26d-b35226c182e0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2076222191',display_name='tempest-AttachSCSIVolumeTestJSON-server-2076222191',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2076222191',id=6,image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBM+Bfdjrc1z6m5Eg3rYjr4sKoT9/7HmKHm9lOfqSoK/EFoc1lWSu8bloRjwlgV3xFo5SOarsLfJGo3jR3YD/aECNJ0WwSTUnoGH0UPC2F4as31mXRYm1pgg0dwlWSz4Kg==',key_name='tempest-keypair-1570238364',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1004a6f33134793a0cc103283938f9d',ramdisk_id='',reservation_id='r-oc3nnq7w',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='8f96f4d1-f0ca-42cb-ac52-06251945db8c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-730684174',owner_user_name='tempest-AttachSCSIVolumeTestJSON-730684174-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2422e8bffd4431987796d85a5d5fcc8',uuid=5875141e-b743-4f59-a26d-b35226c182e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converting VIF {"id": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "address": "fa:16:3e:d9:e4:db", "network": {"id": "e892c40a-3246-4869-a68e-1b33dd52a599", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1864922478-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1004a6f33134793a0cc103283938f9d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e511ef-66", "ovs_interfaceid": "47e511ef-668a-4ed7-9e49-ccb3719723a5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG os_vif [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e511ef-66, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3833edc4-8941-42b1-b942-8a29080a9fe8) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:41 user nova-compute[75621]: INFO os_vif [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:e4:db,bridge_name='br-int',has_traffic_filtering=True,id=47e511ef-668a-4ed7-9e49-ccb3719723a5,network=Network(e892c40a-3246-4869-a68e-1b33dd52a599),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e511ef-66')
Nov 27 23:03:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Deleting instance files /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0_del
Nov 27 23:03:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Deletion of /opt/stack/data/nova/instances/5875141e-b743-4f59-a26d-b35226c182e0_del complete
Nov 27 23:03:41 user nova-compute[75621]: INFO nova.compute.manager [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 27 23:03:41 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:03:41 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:42 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Took 0.67 seconds to deallocate network for instance.
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-68918a60-d851-4f0b-ad7c-a96938c26328 req-79608fc0-343f-4bb8-b7cb-d019deb69e55 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-deleted-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:42 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Deleted allocations for instance 5875141e-b743-4f59-a26d-b35226c182e0
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f5a670a1-aa1e-4c7d-9d4f-7d148b52414d tempest-AttachSCSIVolumeTestJSON-730684174 tempest-AttachSCSIVolumeTestJSON-730684174-project-member] Lock "5875141e-b743-4f59-a26d-b35226c182e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] Acquiring lock "5875141e-b743-4f59-a26d-b35226c182e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] Lock "5875141e-b743-4f59-a26d-b35226c182e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] No waiting events found dispatching network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:42 user nova-compute[75621]: WARNING nova.compute.manager [req-4be7a4bb-bf5f-4e20-afc3-7eff38a0d473 req-5f462a24-ffbd-4acf-8960-586c3d719d26 service nova] [instance: 5875141e-b743-4f59-a26d-b35226c182e0] Received unexpected event network-vif-plugged-47e511ef-668a-4ed7-9e49-ccb3719723a5 for instance with vm_state deleted and task_state None.
Nov 27 23:03:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-changed-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing instance network info cache due to event network-changed-0549eeab-0e55-4e1c-b41b-4e990f0fd13c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] Acquiring lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] Acquired lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Refreshing network info cache for port 0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:45 user nova-compute[75621]: INFO nova.compute.manager [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Terminating instance
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updated VIF entry in instance network info cache for port 0549eeab-0e55-4e1c-b41b-4e990f0fd13c. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b990138-4589-48ab-a86e-cf8f3f032d5d req-b8bae0d1-e3a8-4f6d-abb8-e01d9375b9a7 service nova] Releasing lock "refresh_cache-02b2be65-783d-4d2d-a968-5cfd3f62ef1e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f is timed out.
Nov 27 23:03:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully detached device vdb from instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f from the live domain config.
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VPkjKYCg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c36ced-f37a-4372-be45-df54731ab943]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:45 user nova-compute[75621]: No targets found.
Nov 27 23:03:45 user nova-compute[75621]: iSNS:
Nov 27 23:03:45 user nova-compute[75621]: No targets found.
Nov 27 23:03:45 user nova-compute[75621]: STATIC:
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466
Nov 27 23:03:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:45 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:45 user nova-compute[75621]: No targets found.
Nov 27 23:03:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:45 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:45 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-2d634463-6675-4e29-802f-afd568e80f29 req-645609ca-b860-40a9-adc9-6d63a54a307c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e72853-4a7a-45d6-a74a-25626070e93c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6c06e5-d7fe-446c-afe0-0829669fa3e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e075bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5'): ({'sdg'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Removing single pathed devices sdg {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b01c1-50ec-4f20-9f05-e2b01561cb6b]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c99f8-0164-49f1-bbcc-cd46a9ed6096]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Flushing IO for device /dev/sdg {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a27bd7-902e-40af-a3be-dad91ffeedd0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.057s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[008456c3-b8e9-4f8c-ad87-4267141a64f9]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe55c92-e7d4-4fe7-adeb-408b3d719db4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d51395-a53b-4799-a1fa-691bde371267]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260]
Nov 27 23:03:46 user nova-compute[75621]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a26b734-9cba-451c-8954-b5ea9754e5c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2610e1-8ba1-4d97-8de9-72ad30dc53b0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] <== disconnect_volume: return (440ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-3f4db5ff-05d7-4c93-b558-136ca157983b req-849e347c-89a4-4157-9beb-424af7c32de6 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:46 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f4db7063-348e-4c7a-97d9-1b014e453e39 is timed out.
Nov 27 23:03:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully detached device vdb from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the live domain config.
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fpXCduoh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:46 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-60b919e7-a392-46a7-ba42-8a529177a820 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:46 user nova-compute[75621]: WARNING nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-60b919e7-a392-46a7-ba42-8a529177a820 for instance with vm_state active and task_state deleting.
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:46 user nova-compute[75621]: WARNING nova.compute.manager [req-00659412-3a0b-40f4-8ae8-1c6b302016f1 req-c16ca2a1-17e2-4d95-a04b-26394527ec4c service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-64c0f9a9-88e8-4946-8946-4f8fddf685a9 for instance with vm_state active and task_state deleting.
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98017d63-c205-4646-aafd-968056af5978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:46 user nova-compute[75621]: No targets found.
Nov 27 23:03:46 user nova-compute[75621]: iSNS:
Nov 27 23:03:46 user nova-compute[75621]: No targets found.
Nov 27 23:03:46 user nova-compute[75621]: STATIC:
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466
Nov 27 23:03:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:46 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:46 user nova-compute[75621]: No targets found.
Nov 27 23:03:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:46 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:46 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa5d9f-9aa8-465f-a1af-46c2afb8e618]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efa0618-32a3-40bb-a0a3-3412985c77ed]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 (non-flash)
Nov 27 23:03:47 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e075ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735'): ({'sdh'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Removing single pathed devices sdh {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7d02ef-95fd-4d3d-8d3b-cbdc3930354f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a59c5d2-e6ab-49d2-aa81-aee3e060d981]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Flushing IO for device /dev/sdh {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3c47e-bc6d-4d60-b7e3-676d50dd7a38]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a3367-8f92-41b9-8d35-0f46b267fca1]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] SCSI volumes sdh have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5fdb3-2fed-4a46-a890-5a064ecadc46]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'flavor' on Instance uuid 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --logout" returned: 0 in 0.119s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b882e297-7dd3-47bb-9064-38e6d5f584bc]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260]
Nov 27 23:03:47 user nova-compute[75621]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:47 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6acf73a5-4335-40b3-b1c5-1a47414febde tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dfeca57-be14-4b9f-9f42-465b2b181735 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b081d1-db01-4084-9ff0-cbf3988718e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] <== disconnect_volume: return (461ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Instance destroyed successfully.
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lazy-loading 'resources' on Instance uuid 02b2be65-783d-4d2d-a968-5cfd3f62ef1e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0549eeab-0e, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=861af2d9-bfb5-4fc7-802d-47c99e93b564) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:75:58,bridge_name='br-int',has_traffic_filtering=True,id=0549eeab-0e55-4e1c-b41b-4e990f0fd13c,network=Network(cf1d6b16-dbb5-44f7-8d95-52d15bd883a4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0549eeab-0e')
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce067877-6c, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3df3f1a-ebcc-4d24-9710-aae6e1fc7347) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:4a:03,bridge_name='br-int',has_traffic_filtering=True,id=ce067877-6c3e-4646-b8ff-6f845da48953,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapce067877-6c')
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60b919e7-a3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=532830dd-81a2-4d04-8eb0-a5b85e8f4e7b) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-0549eeab-0e55-4e1c-b41b-4e990f0fd13c for instance with vm_state active and task_state deleting.
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-ce067877-6c3e-4646-b8ff-6f845da48953 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-ce067877-6c3e-4646-b8ff-6f845da48953 for instance with vm_state active and task_state deleting.
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING nova.compute.manager [req-210b9864-945d-467e-b349-167791305cc2 req-4cecee69-39df-430c-a474-b91cc852cfe2 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-e1962a4c-7e9a-4293-b278-e2b4efad2889 for instance with vm_state active and task_state deleting.
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:c1:0a,bridge_name='br-int',has_traffic_filtering=True,id=60b919e7-a392-46a7-ba42-8a529177a820,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap60b919e7-a3')
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "address": "fa:16:3e:ea:34:a4", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.195", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1962a4c-7e", "ovs_interfaceid": "e1962a4c-7e9a-4293-b278-e2b4efad2889", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1962a4c-7e, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=563073b1-8ee0-4a3b-a100-f1aecfecba4e) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:34:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1962a4c-7e9a-4293-b278-e2b4efad2889,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1962a4c-7e')
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64c0f9a9-88, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d86079bb-8cd2-4c08-aae9-93b66e4fdb3f) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:19:48,bridge_name='br-int',has_traffic_filtering=True,id=64c0f9a9-88e8-4946-8946-4f8fddf685a9,network=Network(c53758cf-8a7a-4268-a5af-76da1c8e9ead),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64c0f9a9-88')
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4f8ca54-7b, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aabfd5bc-1770-4d73-b710-d67438b4a358) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:bd,bridge_name='br-int',has_traffic_filtering=True,id=f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4f8ca54-7b')
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1846313793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1846313793',id=10,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUyIh6SX019dwRLfGKpazpqqisS7aDhCbGOWjZfmC2tsvNdBeKE1VhOS24XUtZpEVSut7EnWXcMOOyMp021rLeaRf6nR45gD5nBV+J+tzPiZAd6GpfGhv1CZvEWRV/vYw==',key_name='tempest-keypair-1334255680',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e50cf1304e5e4dd98bd232dd20902a14',ramdisk_id='',reservation_id='r-4fz1steb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-778294445',owner_user_name='tempest-TaggedBootDevicesTest_v242-778294445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0bd4c58b96942caaf91dacc21ce7b02',uuid=02b2be65-783d-4d2d-a968-5cfd3f62ef1e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converting VIF {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc83c86-66, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bb7ba1d-85b8-4988-8145-097fb0ae51a8) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:48 user nova-compute[75621]: INFO os_vif [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:6e:2d,bridge_name='br-int',has_traffic_filtering=True,id=6cc83c86-666b-4862-9608-c20881403c00,network=Network(511e82e6-fb8c-464a-8b5f-d9549942e00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc83c86-66')
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ToJmrFEG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5efcde50-4fb0-4543-87da-73e234e14681 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.029s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dc791a-aa83-48c2-9059-1afd6a032485]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]: iSNS:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]: STATIC:
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:48 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:48 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b25b5e-6d7f-44ce-8b1a-623d6ede8484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[239f7851-d39b-4d16-af2d-49a8e08fc851]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e077e050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fee7ef-1b99-4ae5-8033-fe75d068b45a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0628b28a-39a4-4e76-b929-223ac1e8a07b]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[818c7a07-0239-43e6-a639-fec73c849552]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ec983f-e49f-4249-92c7-b6dbec1c16bd]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe95864-83d2-4c90-9386-b8f3920bd348]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f02d652-6417-4aa2-b7cd-b66962a077e4]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260]
Nov 27 23:03:48 user nova-compute[75621]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:03584c22-7ad5-4fd5-b535-1b04ef96a466 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec924531-44fc-4831-9841-36e8529585b6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== disconnect_volume: return (336ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Rkmerqcv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba54e20-dc6a-4b33-bb16-8b53cda10907]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]: iSNS:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]: STATIC:
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:48 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:48 user nova-compute[75621]: No targets found.
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:48 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:48 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c099dc71-c307-4b4c-939e-804dde3eb668]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d67295-0972-4f01-b705-4fd9aac18435]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e075acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b2ee96-ad1e-4633-9e80-52b775e4ee51]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-0a6e2f35-0ea4-4277-add6-1f73f45bee02" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-0a6e2f35-0ea4-4277-add6-1f73f45bee02" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 for instance with vm_state active and task_state deleting.
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-unplugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-unplugged-6cc83c86-666b-4862-9608-c20881403c00 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Acquiring lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] No waiting events found dispatching network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:48 user nova-compute[75621]: WARNING nova.compute.manager [req-d3a7ab23-2d6f-467d-9e0b-0f3c68a84ea9 req-198782cb-2f37-4e67-adc8-693a84a1659e service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received unexpected event network-vif-plugged-6cc83c86-666b-4862-9608-c20881403c00 for instance with vm_state active and task_state deleting.
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4155ac3b-1fa5-4f67-a3d2-c57776d23d86]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[151e7836-4c3b-4ebb-b40d-b5ac3f931c52]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:03:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Attempting to detach device tap0a6e2f35-0e from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] detach device xml: <interface type="ethernet">
Nov 27 23:03:49 user nova-compute[75621]:   <mac address="fa:16:3e:8c:71:b8"/>
Nov 27 23:03:49 user nova-compute[75621]:   <model type="virtio"/>
Nov 27 23:03:49 user nova-compute[75621]:   <mtu size="1442"/>
Nov 27 23:03:49 user nova-compute[75621]:   <target dev="tap0a6e2f35-0e"/>
Nov 27 23:03:49 user nova-compute[75621]: </interface>
Nov 27 23:03:49 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 27 23:03:49 user nova-compute[75621]:   <name>instance-00000008</name>
Nov 27 23:03:49 user nova-compute[75621]:   <uuid>f4db7063-348e-4c7a-97d9-1b014e453e39</uuid>
Nov 27 23:03:49 user nova-compute[75621]:   <metadata>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:03:49 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:03:10</nova:creationTime>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:03:49 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:03:49 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:owner>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:03:49 user nova-compute[75621]:   </nova:owner>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:03:49 user nova-compute[75621]:   <nova:ports>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:03:49 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:03:49 user nova-compute[75621]:     </nova:port>
Nov 27 23:03:49 user nova-compute[75621]:     <nova:port uuid="0a6e2f35-0ea4-4277-add6-1f73f45bee02">
Nov 27 23:03:49 user nova-compute[75621]:       <nova:ip type="fixed" address="10.10.10.3" ipVersion="4"/>
Nov 27 23:03:49 user nova-compute[75621]:     </nova:port>
Nov 27 23:03:49 user nova-compute[75621]:   </nova:ports>
Nov 27 23:03:49 user nova-compute[75621]: </nova:instance>
Nov 27 23:03:49 user nova-compute[75621]:   </metadata>
Nov 27 23:03:49 user nova-compute[75621]:   <memory unit='KiB'>524288</memory>
Nov 27 23:03:49 user nova-compute[75621]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 23:03:49 user nova-compute[75621]:   <vcpu placement='static'>1</vcpu>
Nov 27 23:03:49 user nova-compute[75621]:   <resource>
Nov 27 23:03:49 user nova-compute[75621]:     <partition>/machine</partition>
Nov 27 23:03:49 user nova-compute[75621]:   </resource>
Nov 27 23:03:49 user nova-compute[75621]:   <sysinfo type='smbios'>
Nov 27 23:03:49 user nova-compute[75621]:     <system>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='version'>0.0.0</entry>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='serial'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='uuid'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:03:49 user nova-compute[75621]:       <entry name='family'>Virtual Machine</entry>
Nov 27 23:03:49 user nova-compute[75621]:     </system>
Nov 27 23:03:49 user nova-compute[75621]:   </sysinfo>
Nov 27 23:03:49 user nova-compute[75621]:   <os>
Nov 27 23:03:49 user nova-compute[75621]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 23:03:49 user nova-compute[75621]:     <boot dev='hd'/>
Nov 27 23:03:49 user nova-compute[75621]:     <smbios mode='sysinfo'/>
Nov 27 23:03:49 user nova-compute[75621]:   </os>
Nov 27 23:03:49 user nova-compute[75621]:   <features>
Nov 27 23:03:49 user nova-compute[75621]:     <acpi/>
Nov 27 23:03:49 user nova-compute[75621]:     <apic/>
Nov 27 23:03:49 user nova-compute[75621]:     <vmcoreinfo state='on'/>
Nov 27 23:03:49 user nova-compute[75621]:   </features>
Nov 27 23:03:49 user nova-compute[75621]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 23:03:49 user nova-compute[75621]:     <model fallback='forbid'>Nehalem</model>
Nov 27 23:03:49 user nova-compute[75621]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 23:03:49 user nova-compute[75621]:     <feature policy='require' name='vme'/>
Nov 27 23:03:49 user nova-compute[75621]:     <feature policy='require' name='x2apic'/>
Nov 27 23:03:49 user nova-compute[75621]:     <feature policy='require' name='hypervisor'/>
Nov 27 23:03:49 user nova-compute[75621]:   </cpu>
Nov 27 23:03:49 user nova-compute[75621]:   <clock offset='utc'>
Nov 27 23:03:49 user nova-compute[75621]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 23:03:49 user nova-compute[75621]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 23:03:49 user nova-compute[75621]:     <timer name='hpet' present='no'/>
Nov 27 23:03:49 user nova-compute[75621]:   </clock>
Nov 27 23:03:49 user nova-compute[75621]:   <on_poweroff>destroy</on_poweroff>
Nov 27 23:03:49 user nova-compute[75621]:   <on_reboot>restart</on_reboot>
Nov 27 23:03:49 user nova-compute[75621]:   <on_crash>destroy</on_crash>
Nov 27 23:03:49 user nova-compute[75621]:   <devices>
Nov 27 23:03:49 user nova-compute[75621]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 23:03:49 user nova-compute[75621]:     <disk type='file' device='disk'>
Nov 27 23:03:49 user nova-compute[75621]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 23:03:49 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk' index='2'/>
Nov 27 23:03:49 user nova-compute[75621]:       <backingStore type='file' index='3'>
Nov 27 23:03:49 user nova-compute[75621]:         <format type='raw'/>
Nov 27 23:03:49 user nova-compute[75621]:         <source file='/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f'/>
Nov 27 23:03:49 user nova-compute[75621]:         <backingStore/>
Nov 27 23:03:49 user nova-compute[75621]:       </backingStore>
Nov 27 23:03:49 user nova-compute[75621]:       <target dev='vda' bus='virtio'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='virtio-disk0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </disk>
Nov 27 23:03:49 user nova-compute[75621]:     <disk type='file' device='cdrom'>
Nov 27 23:03:49 user nova-compute[75621]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 23:03:49 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config' index='1'/>
Nov 27 23:03:49 user nova-compute[75621]:       <backingStore/>
Nov 27 23:03:49 user nova-compute[75621]:       <target dev='hda' bus='ide'/>
Nov 27 23:03:49 user nova-compute[75621]:       <readonly/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='ide0-0-0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </disk>
Nov 27 23:03:49 user nova-compute[75621]:     <controller type='usb' index='0' model='none'>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='usb'/>
Nov 27 23:03:49 user nova-compute[75621]:     </controller>
Nov 27 23:03:49 user nova-compute[75621]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='pci.0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </controller>
Nov 27 23:03:49 user nova-compute[75621]:     <controller type='ide' index='0'>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='ide'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 23:03:49 user nova-compute[75621]:     </controller>
Nov 27 23:03:49 user nova-compute[75621]:     <interface type='ethernet'>
Nov 27 23:03:49 user nova-compute[75621]:       <mac address='fa:16:3e:fe:7a:1b'/>
Nov 27 23:03:49 user nova-compute[75621]:       <target dev='tapd06cc534-9b'/>
Nov 27 23:03:49 user nova-compute[75621]:       <model type='virtio'/>
Nov 27 23:03:49 user nova-compute[75621]:       <mtu size='1442'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='net0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </interface>
Nov 27 23:03:49 user nova-compute[75621]:     <interface type='ethernet'>
Nov 27 23:03:49 user nova-compute[75621]:       <mac address='fa:16:3e:8c:71:b8'/>
Nov 27 23:03:49 user nova-compute[75621]:       <target dev='tap0a6e2f35-0e'/>
Nov 27 23:03:49 user nova-compute[75621]:       <model type='virtio'/>
Nov 27 23:03:49 user nova-compute[75621]:       <mtu size='1442'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='net1'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </interface>
Nov 27 23:03:49 user nova-compute[75621]:     <serial type='pty'>
Nov 27 23:03:49 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:03:49 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:03:49 user nova-compute[75621]:       <target type='isa-serial' port='0'>
Nov 27 23:03:49 user nova-compute[75621]:         <model name='isa-serial'/>
Nov 27 23:03:49 user nova-compute[75621]:       </target>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </serial>
Nov 27 23:03:49 user nova-compute[75621]:     <console type='pty' tty='/dev/pts/7'>
Nov 27 23:03:49 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:03:49 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:03:49 user nova-compute[75621]:       <target type='serial' port='0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </console>
Nov 27 23:03:49 user nova-compute[75621]:     <input type='mouse' bus='ps2'>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='input0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </input>
Nov 27 23:03:49 user nova-compute[75621]:     <input type='keyboard' bus='ps2'>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='input1'/>
Nov 27 23:03:49 user nova-compute[75621]:     </input>
Nov 27 23:03:49 user nova-compute[75621]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 27 23:03:49 user nova-compute[75621]:       <listen type='address' address='0.0.0.0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </graphics>
Nov 27 23:03:49 user nova-compute[75621]:     <audio id='1' type='none'/>
Nov 27 23:03:49 user nova-compute[75621]:     <video>
Nov 27 23:03:49 user nova-compute[75621]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='video0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </video>
Nov 27 23:03:49 user nova-compute[75621]:     <memballoon model='virtio'>
Nov 27 23:03:49 user nova-compute[75621]:       <stats period='10'/>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='balloon0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </memballoon>
Nov 27 23:03:49 user nova-compute[75621]:     <rng model='virtio'>
Nov 27 23:03:49 user nova-compute[75621]:       <backend model='random'>/dev/urandom</backend>
Nov 27 23:03:49 user nova-compute[75621]:       <alias name='rng0'/>
Nov 27 23:03:49 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 23:03:49 user nova-compute[75621]:     </rng>
Nov 27 23:03:49 user nova-compute[75621]:   </devices>
Nov 27 23:03:49 user nova-compute[75621]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 23:03:49 user nova-compute[75621]:     <label>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</label>
Nov 27 23:03:49 user nova-compute[75621]:     <imagelabel>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</imagelabel>
Nov 27 23:03:49 user nova-compute[75621]:   </seclabel>
Nov 27 23:03:49 user nova-compute[75621]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 23:03:49 user nova-compute[75621]:     <label>+64055:+108</label>
Nov 27 23:03:49 user nova-compute[75621]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 23:03:49 user nova-compute[75621]:   </seclabel>
Nov 27 23:03:49 user nova-compute[75621]: </domain>
Nov 27 23:03:49 user nova-compute[75621]:  {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 23:03:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully detached device tap0a6e2f35-0e from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the persistent domain config.
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] (1/8): Attempting to detach device tap0a6e2f35-0e with device alias net1 from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] detach device xml: <interface type="ethernet">
Nov 27 23:03:49 user nova-compute[75621]:   <mac address="fa:16:3e:8c:71:b8"/>
Nov 27 23:03:49 user nova-compute[75621]:   <model type="virtio"/>
Nov 27 23:03:49 user nova-compute[75621]:   <mtu size="1442"/>
Nov 27 23:03:49 user nova-compute[75621]:   <target dev="tap0a6e2f35-0e"/>
Nov 27 23:03:49 user nova-compute[75621]: </interface>
Nov 27 23:03:49 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b841d9-7c04-46ae-8992-5b7a8e6b2fee]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabb98af-83c2-4345-b9bc-24618332d8ce]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a14a6d-cf53-4927-ba04-0ac965e2355b]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260]
Nov 27 23:03:49 user nova-compute[75621]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec1450c-6cf5-4ef0-8337-f2fa00e0be03 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e193a185-fe0c-40ac-8912-375ee84f8e14]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== disconnect_volume: return (374ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qCUZyBaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:49 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5691a-9028-48b4-a356-449d3fce7702]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:49 user nova-compute[75621]: No targets found.
Nov 27 23:03:49 user nova-compute[75621]: iSNS:
Nov 27 23:03:49 user nova-compute[75621]: No targets found.
Nov 27 23:03:49 user nova-compute[75621]: STATIC:
Nov 27 23:03:49 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:49 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:49 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:49 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:49 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:49 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:49 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58
Nov 27 23:03:49 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:49 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:49 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:49 user nova-compute[75621]: No targets found.
Nov 27 23:03:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:49 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:49 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91089fa3-3f0f-4777-8320-1c8282aa2947]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e286ab84-a605-47bf-8636-32e7d2d33c0b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:49 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:49 user nova-compute[75621]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 (non-flash)
Nov 27 23:03:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e075b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8713e41-e1d3-4aa2-b494-501cc4f39406]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19cfada-8882-4b33-9ef4-9d51c51b77f5]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25b2933-cf1a-4b06-a2cb-41c7c1a333b0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Start waiting for the detach event from libvirt for device tap0a6e2f35-0e with device alias net1 for instance f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91874bb9-f409-478c-b8c4-c08fb4be784d]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eb2f6c-656c-4b56-b64f-4d5a50618ade]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee31e373-7f89-4b6f-acbb-e0d216f06318]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260]
Nov 27 23:03:49 user nova-compute[75621]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9264d001-8919-4c33-9aa8-bcc6a511ba58 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafba984-65dd-4462-a4a1-0337eb66dc7b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] <== disconnect_volume: return (373ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Deleting instance files /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e_del
Nov 27 23:03:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Deletion of /opt/stack/data/nova/instances/02b2be65-783d-4d2d-a968-5cfd3f62ef1e_del complete
Nov 27 23:03:49 user nova-compute[75621]: INFO nova.compute.manager [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Took 3.97 seconds to destroy the instance on the hypervisor.
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-unplugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-unplugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:50 user nova-compute[75621]: WARNING nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-unplugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 for instance with vm_state active and task_state None.
Nov 27 23:03:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:03:50 user nova-compute[75621]: WARNING nova.compute.manager [req-df9a493e-d97d-4168-8891-c0a5d6c866e1 req-77865b7b-29d7-4c2c-95fd-7268b56c9aa9 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-0a6e2f35-0ea4-4277-add6-1f73f45bee02 for instance with vm_state active and task_state None.
Nov 27 23:03:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Error from libvirt while getting description of instance-0000000a: [Error Code 42] Domain not found: no domain with matching uuid '02b2be65-783d-4d2d-a968-5cfd3f62ef1e' (instance-0000000a): libvirt.libvirtError: Domain not found: no domain with matching uuid '02b2be65-783d-4d2d-a968-5cfd3f62ef1e' (instance-0000000a)
Nov 27 23:03:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:03:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7802MB free_disk=25.37710952758789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f4db7063-348e-4c7a-97d9-1b014e453e39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance dfdff3c7-4ea4-4c11-a737-71c46c844fce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 02b2be65-783d-4d2d-a968-5cfd3f62ef1e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 521810a6-88ad-46c0-b73c-d77f6b26a66e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-2acbf632-5eb8-45ad-915b-43f939ca1d5f req-9e0d5577-94c0-498a-8690-c013f1662f40 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-deleted-e1962a4c-7e9a-4293-b278-e2b4efad2889 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:51 user nova-compute[75621]: INFO nova.compute.manager [req-2acbf632-5eb8-45ad-915b-43f939ca1d5f req-9e0d5577-94c0-498a-8690-c013f1662f40 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Neutron deleted interface e1962a4c-7e9a-4293-b278-e2b4efad2889; detaching it from the instance and deleting it from the info cache
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.network.neutron [req-2acbf632-5eb8-45ad-915b-43f939ca1d5f req-9e0d5577-94c0-498a-8690-c013f1662f40 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [{"id": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "address": "fa:16:3e:54:75:58", "network": {"id": "cf1d6b16-dbb5-44f7-8d95-52d15bd883a4", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1468860002-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0549eeab-0e", "ovs_interfaceid": "0549eeab-0e55-4e1c-b41b-4e990f0fd13c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce067877-6c3e-4646-b8ff-6f845da48953", "address": "fa:16:3e:0a:4a:03", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce067877-6c", "ovs_interfaceid": "ce067877-6c3e-4646-b8ff-6f845da48953", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "60b919e7-a392-46a7-ba42-8a529177a820", "address": "fa:16:3e:ab:c1:0a", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.63", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60b919e7-a3", "ovs_interfaceid": "60b919e7-a392-46a7-ba42-8a529177a820", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "address": "fa:16:3e:c4:19:48", "network": {"id": "c53758cf-8a7a-4268-a5af-76da1c8e9ead", "bridge": "br-int", "label": "tempest-device-tagging-net1-1854218383", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64c0f9a9-88", "ovs_interfaceid": "64c0f9a9-88e8-4946-8946-4f8fddf685a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "address": "fa:16:3e:46:71:bd", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4f8ca54-7b", "ovs_interfaceid": "f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6cc83c86-666b-4862-9608-c20881403c00", "address": "fa:16:3e:37:6e:2d", "network": {"id": "511e82e6-fb8c-464a-8b5f-d9549942e00e", "bridge": "br-int", "label": "tempest-device-tagging-net2-526522498", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "e50cf1304e5e4dd98bd232dd20902a14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc83c86-66", "ovs_interfaceid": "6cc83c86-666b-4862-9608-c20881403c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-2acbf632-5eb8-45ad-915b-43f939ca1d5f req-9e0d5577-94c0-498a-8690-c013f1662f40 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Detach interface failed, port_id=e1962a4c-7e9a-4293-b278-e2b4efad2889, reason: Instance 02b2be65-783d-4d2d-a968-5cfd3f62ef1e could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:03:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.512s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:52 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dfdff3c7-4ea4-4c11-a737-71c46c844fce is timed out.
Nov 27 23:03:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Successfully detached device vdb from instance dfdff3c7-4ea4-4c11-a737-71c46c844fce from the live domain config.
Nov 27 23:03:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKPNqjyU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:03:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[40452dd5-7b70-4629-a6ee-61ecb0886b9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:03:52 user nova-compute[75621]: No targets found.
Nov 27 23:03:52 user nova-compute[75621]: iSNS:
Nov 27 23:03:52 user nova-compute[75621]: No targets found.
Nov 27 23:03:52 user nova-compute[75621]: STATIC:
Nov 27 23:03:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d
Nov 27 23:03:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:03:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:03:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:03:52 user nova-compute[75621]: FIRMWARE:
Nov 27 23:03:52 user nova-compute[75621]: No targets found.
Nov 27 23:03:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:03:52 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:03:52 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2b1d36-78dc-45d3-a1c8-9ab22074a552]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c0e082-9b35-40b8-a243-65d742c4594b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:52 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d (non-flash)
Nov 27 23:03:52 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:03:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130073f2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d'): ({'sdi'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Removing single pathed devices sdi {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91339d4c-e376-4efc-bb2b-7a2d56121db7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[93203aa7-a741-47d6-b9fe-a9bbf9e9a634]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Flushing IO for device /dev/sdi {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ba18bd-8006-46a0-a4f5-bb128b5fdd3c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6ca14-e7ea-41c6-87cb-2cd4de00f620]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] SCSI volumes sdi have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3341df-5d0f-4e69-848d-f7d84d739cd1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3097b228-9d3f-43c5-b8a7-2b42f97ee097]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260]
Nov 27 23:03:52 user nova-compute[75621]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d, portal: 172.16.0.220,3260] successful.
Nov 27 23:03:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9780afcd-f066-4d2f-a396-1cbd8346c97d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a626df46-ca10-4f0d-b23b-79fd4fde3ed5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] <== disconnect_volume: return (297ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lazy-loading 'flavor' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-74d44a37-489b-4f49-b90b-1572223bfd4f tempest-VolumesAssistedSnapshotsTest-868248074 tempest-VolumesAssistedSnapshotsTest-868248074-project-admin] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.712s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:53 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Took 3.88 seconds to deallocate network for instance.
Nov 27 23:03:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-09afe4d0-bfe9-4625-b548-10f183317724 req-4428ebf6-b6c7-4e3b-a08a-0875707cdb08 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-deleted-64c0f9a9-88e8-4946-8946-4f8fddf685a9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-09afe4d0-bfe9-4625-b548-10f183317724 req-4428ebf6-b6c7-4e3b-a08a-0875707cdb08 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-deleted-6cc83c86-666b-4862-9608-c20881403c00 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-09afe4d0-bfe9-4625-b548-10f183317724 req-4428ebf6-b6c7-4e3b-a08a-0875707cdb08 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-deleted-0549eeab-0e55-4e1c-b41b-4e990f0fd13c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-09afe4d0-bfe9-4625-b548-10f183317724 req-4428ebf6-b6c7-4e3b-a08a-0875707cdb08 service nova] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Received event network-vif-deleted-f4f8ca54-7b86-4b27-b900-cbd44dc5a9d4 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:03:54 user nova-compute[75621]: INFO nova.compute.claims [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Claim successful on node user
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:03:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:03:54 user nova-compute[75621]: DEBUG nova.policy [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506743bc2ab54538b400595de8792b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef81acb6ed764a23a83269df20981c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:03:54 user nova-compute[75621]: INFO nova.virt.block_device [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Booting with blank volume at /dev/vda
Nov 27 23:03:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Successfully created port: ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:03:55 user nova-compute[75621]: INFO nova.compute.manager [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] [instance: 02b2be65-783d-4d2d-a968-5cfd3f62ef1e] Took 2.33 seconds to detach 3 volumes for instance.
Nov 27 23:03:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:03:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:03:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Successfully updated port: ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:03:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-changed-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Refreshing instance network info cache due to event network-changed-ac7d5fc9-24e0-4544-a84e-187023fd6e8a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] Acquiring lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:56 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Deleted allocations for instance 02b2be65-783d-4d2d-a968-5cfd3f62ef1e
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance network_info: |[{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] Acquired lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Refreshing network info cache for port ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dc7ab658-d8e3-443d-874e-4a7ea753d66b tempest-TaggedBootDevicesTest_v242-778294445 tempest-TaggedBootDevicesTest_v242-778294445-project-member] Lock "02b2be65-783d-4d2d-a968-5cfd3f62ef1e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.755s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:03:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:57 user nova-compute[75621]: DEBUG nova.network.neutron [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updated VIF entry in instance network info cache for port ac7d5fc9-24e0-4544-a84e-187023fd6e8a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:03:57 user nova-compute[75621]: DEBUG nova.network.neutron [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:03:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d0a28050-683a-4f5a-97d9-d915c7997ff5 req-aa32959e-391b-4ba8-a316-7ed255a2b5ba service nova] Releasing lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:03:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:03:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.utils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af49ae2d-1622-4957-9c9d-ae11660be6f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9327f0-4745-447f-b700-91381843ff92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff6d160-1da6-473b-a614-822feba3bba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf970e55-f639-4c4c-acf0-1c6c206e79d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:00 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:00 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b04730-f0e5-49dd-9d06-45434023543d]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG os_brick.utils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:00 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating existing volume attachment record: 32e0081c-4a82-42d9-98d7-6a586a1a89ee {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:04:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:04:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Creating image(s)
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Ensure instance console log exists: /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start _get_guest_xml network_info=[{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '32e0081c-4a82-42d9-98d7-6a586a1a89ee', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b75ec495-38b4-42ff-a489-13b76129b094', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'serial': 'b4e8520c-4c32-4d15-9ae3-7fc63e2aae25'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:04:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:07 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:07 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:07 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c0f43-16cb-445a-b408-303fce05341c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:07 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea92240-2d6b-44ea-9c9c-16a3d388bac9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25] added
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2153af-a102-4dd7-8742-25a2205cd8f2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b85713-131e-4f75-a5fb-391fd7a37330]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgxoOQDU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgxoOQDU" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e0ab5e-56ed-4625-bb91-665d2eab6a40]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgxoOQDU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab148ceb-1d0b-497e-891e-cfb46ec7f4e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[81304a3e-324e-43fc-8fd9-546c0cdd18d0]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bac1c22-410f-4952-b7ac-caacce8d320e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260]
Nov 27 23:04:07 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2603cf-3b06-4f71-9873-273dd363ad73]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef2f1a5-4237-426a-948f-f7b760f52671]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:07 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef68ca15-92d0-42b0-9e0e-a4049afbc0f2]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26233346231636234', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233346231636234', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4921025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4921025',id=12,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-4qj2t6f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:03:55Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=b75ec495-38b4-42ff-a489-13b76129b094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:04:08 user nova-compute[75621]:   <uuid>b75ec495-38b4-42ff-a489-13b76129b094</uuid>
Nov 27 23:04:08 user nova-compute[75621]:   <name>instance-0000000c</name>
Nov 27 23:04:08 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:04:08 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:04:08 user nova-compute[75621]:   <metadata>
Nov 27 23:04:08 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:08 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-4921025</nova:name>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:04:07</nova:creationTime>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:04:08 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:08 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:owner>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:04:08 user nova-compute[75621]:       </nova:owner>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:08 user nova-compute[75621]:       <nova:ports>
Nov 27 23:04:08 user nova-compute[75621]:         <nova:port uuid="ac7d5fc9-24e0-4544-a84e-187023fd6e8a">
Nov 27 23:04:08 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 23:04:08 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:08 user nova-compute[75621]:       </nova:ports>
Nov 27 23:04:08 user nova-compute[75621]:     </nova:instance>
Nov 27 23:04:08 user nova-compute[75621]:   </metadata>
Nov 27 23:04:08 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:04:08 user nova-compute[75621]:     <system>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="serial">b75ec495-38b4-42ff-a489-13b76129b094</entry>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="uuid">b75ec495-38b4-42ff-a489-13b76129b094</entry>
Nov 27 23:04:08 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:04:08 user nova-compute[75621]:     </system>
Nov 27 23:04:08 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:08 user nova-compute[75621]:   <os>
Nov 27 23:04:08 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:04:08 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:04:08 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:04:08 user nova-compute[75621]:   </os>
Nov 27 23:04:08 user nova-compute[75621]:   <features>
Nov 27 23:04:08 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:08 user nova-compute[75621]:     <apic/>
Nov 27 23:04:08 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:04:08 user nova-compute[75621]:   </features>
Nov 27 23:04:08 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:04:08 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:04:08 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:04:08 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:04:08 user nova-compute[75621]:   </clock>
Nov 27 23:04:08 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:04:08 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:04:08 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:04:08 user nova-compute[75621]:   </cpu>
Nov 27 23:04:08 user nova-compute[75621]:   <devices>
Nov 27 23:04:08 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:04:08 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:08 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:04:08 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:04:08 user nova-compute[75621]:       <serial>b4e8520c-4c32-4d15-9ae3-7fc63e2aae25</serial>
Nov 27 23:04:08 user nova-compute[75621]:     </disk>
Nov 27 23:04:08 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:08 user nova-compute[75621]:       <mac address="fa:16:3e:7c:0f:22"/>
Nov 27 23:04:08 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:08 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:08 user nova-compute[75621]:       <target dev="tapac7d5fc9-24"/>
Nov 27 23:04:08 user nova-compute[75621]:     </interface>
Nov 27 23:04:08 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:04:08 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/console.log" append="off"/>
Nov 27 23:04:08 user nova-compute[75621]:     </serial>
Nov 27 23:04:08 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:04:08 user nova-compute[75621]:     <video>
Nov 27 23:04:08 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:08 user nova-compute[75621]:     </video>
Nov 27 23:04:08 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:04:08 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:04:08 user nova-compute[75621]:     </rng>
Nov 27 23:04:08 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:04:08 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:04:08 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:04:08 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:08 user nova-compute[75621]:   </devices>
Nov 27 23:04:08 user nova-compute[75621]: </domain>
Nov 27 23:04:08 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4921025',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4921025',id=12,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-4qj2t6f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:03:55Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=b75ec495-38b4-42ff-a489-13b76129b094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG os_vif [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81f54556-b41d-5d3e-b730-76023a803333', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac7d5fc9-24, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapac7d5fc9-24, col_values=(('qos', UUID('a361c5c0-5ca4-4b3d-ab18-30e4bf0edc92')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapac7d5fc9-24, col_values=(('external_ids', {'iface-id': 'ac7d5fc9-24e0-4544-a84e-187023fd6e8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:0f:22', 'vm-uuid': 'b75ec495-38b4-42ff-a489-13b76129b094'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:08 user nova-compute[75621]: INFO os_vif [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24')
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:7c:0f:22, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Waiting for libvirt event about the detach of device tap0a6e2f35-0e with device alias net1 from instance f4db7063-348e-4c7a-97d9-1b014e453e39 is timed out.
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 27 23:04:09 user nova-compute[75621]:   <name>instance-00000008</name>
Nov 27 23:04:09 user nova-compute[75621]:   <uuid>f4db7063-348e-4c7a-97d9-1b014e453e39</uuid>
Nov 27 23:04:09 user nova-compute[75621]:   <metadata>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:09 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:03:10</nova:creationTime>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:04:09 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:owner>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:owner>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:ports>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:04:09 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:04:09 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:port uuid="0a6e2f35-0ea4-4277-add6-1f73f45bee02">
Nov 27 23:04:09 user nova-compute[75621]:       <nova:ip type="fixed" address="10.10.10.3" ipVersion="4"/>
Nov 27 23:04:09 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:ports>
Nov 27 23:04:09 user nova-compute[75621]: </nova:instance>
Nov 27 23:04:09 user nova-compute[75621]:   </metadata>
Nov 27 23:04:09 user nova-compute[75621]:   <memory unit='KiB'>524288</memory>
Nov 27 23:04:09 user nova-compute[75621]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 23:04:09 user nova-compute[75621]:   <vcpu placement='static'>1</vcpu>
Nov 27 23:04:09 user nova-compute[75621]:   <resource>
Nov 27 23:04:09 user nova-compute[75621]:     <partition>/machine</partition>
Nov 27 23:04:09 user nova-compute[75621]:   </resource>
Nov 27 23:04:09 user nova-compute[75621]:   <sysinfo type='smbios'>
Nov 27 23:04:09 user nova-compute[75621]:     <system>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='version'>0.0.0</entry>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='serial'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='uuid'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:09 user nova-compute[75621]:       <entry name='family'>Virtual Machine</entry>
Nov 27 23:04:09 user nova-compute[75621]:     </system>
Nov 27 23:04:09 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:09 user nova-compute[75621]:   <os>
Nov 27 23:04:09 user nova-compute[75621]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 23:04:09 user nova-compute[75621]:     <boot dev='hd'/>
Nov 27 23:04:09 user nova-compute[75621]:     <smbios mode='sysinfo'/>
Nov 27 23:04:09 user nova-compute[75621]:   </os>
Nov 27 23:04:09 user nova-compute[75621]:   <features>
Nov 27 23:04:09 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:09 user nova-compute[75621]:     <apic/>
Nov 27 23:04:09 user nova-compute[75621]:     <vmcoreinfo state='on'/>
Nov 27 23:04:09 user nova-compute[75621]:   </features>
Nov 27 23:04:09 user nova-compute[75621]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 23:04:09 user nova-compute[75621]:     <model fallback='forbid'>Nehalem</model>
Nov 27 23:04:09 user nova-compute[75621]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 23:04:09 user nova-compute[75621]:     <feature policy='require' name='vme'/>
Nov 27 23:04:09 user nova-compute[75621]:     <feature policy='require' name='x2apic'/>
Nov 27 23:04:09 user nova-compute[75621]:     <feature policy='require' name='hypervisor'/>
Nov 27 23:04:09 user nova-compute[75621]:   </cpu>
Nov 27 23:04:09 user nova-compute[75621]:   <clock offset='utc'>
Nov 27 23:04:09 user nova-compute[75621]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 23:04:09 user nova-compute[75621]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 23:04:09 user nova-compute[75621]:     <timer name='hpet' present='no'/>
Nov 27 23:04:09 user nova-compute[75621]:   </clock>
Nov 27 23:04:09 user nova-compute[75621]:   <on_poweroff>destroy</on_poweroff>
Nov 27 23:04:09 user nova-compute[75621]:   <on_reboot>restart</on_reboot>
Nov 27 23:04:09 user nova-compute[75621]:   <on_crash>destroy</on_crash>
Nov 27 23:04:09 user nova-compute[75621]:   <devices>
Nov 27 23:04:09 user nova-compute[75621]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 23:04:09 user nova-compute[75621]:     <disk type='file' device='disk'>
Nov 27 23:04:09 user nova-compute[75621]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 23:04:09 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk' index='2'/>
Nov 27 23:04:09 user nova-compute[75621]:       <backingStore type='file' index='3'>
Nov 27 23:04:09 user nova-compute[75621]:         <format type='raw'/>
Nov 27 23:04:09 user nova-compute[75621]:         <source file='/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f'/>
Nov 27 23:04:09 user nova-compute[75621]:         <backingStore/>
Nov 27 23:04:09 user nova-compute[75621]:       </backingStore>
Nov 27 23:04:09 user nova-compute[75621]:       <target dev='vda' bus='virtio'/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='virtio-disk0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </disk>
Nov 27 23:04:09 user nova-compute[75621]:     <disk type='file' device='cdrom'>
Nov 27 23:04:09 user nova-compute[75621]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 23:04:09 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config' index='1'/>
Nov 27 23:04:09 user nova-compute[75621]:       <backingStore/>
Nov 27 23:04:09 user nova-compute[75621]:       <target dev='hda' bus='ide'/>
Nov 27 23:04:09 user nova-compute[75621]:       <readonly/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='ide0-0-0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </disk>
Nov 27 23:04:09 user nova-compute[75621]:     <controller type='usb' index='0' model='none'>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='usb'/>
Nov 27 23:04:09 user nova-compute[75621]:     </controller>
Nov 27 23:04:09 user nova-compute[75621]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='pci.0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </controller>
Nov 27 23:04:09 user nova-compute[75621]:     <controller type='ide' index='0'>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='ide'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 23:04:09 user nova-compute[75621]:     </controller>
Nov 27 23:04:09 user nova-compute[75621]:     <interface type='ethernet'>
Nov 27 23:04:09 user nova-compute[75621]:       <mac address='fa:16:3e:fe:7a:1b'/>
Nov 27 23:04:09 user nova-compute[75621]:       <target dev='tapd06cc534-9b'/>
Nov 27 23:04:09 user nova-compute[75621]:       <model type='virtio'/>
Nov 27 23:04:09 user nova-compute[75621]:       <mtu size='1442'/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='net0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </interface>
Nov 27 23:04:09 user nova-compute[75621]:     <serial type='pty'>
Nov 27 23:04:09 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:09 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:09 user nova-compute[75621]:       <target type='isa-serial' port='0'>
Nov 27 23:04:09 user nova-compute[75621]:         <model name='isa-serial'/>
Nov 27 23:04:09 user nova-compute[75621]:       </target>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </serial>
Nov 27 23:04:09 user nova-compute[75621]:     <console type='pty' tty='/dev/pts/7'>
Nov 27 23:04:09 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:09 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:09 user nova-compute[75621]:       <target type='serial' port='0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </console>
Nov 27 23:04:09 user nova-compute[75621]:     <input type='mouse' bus='ps2'>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='input0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </input>
Nov 27 23:04:09 user nova-compute[75621]:     <input type='keyboard' bus='ps2'>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='input1'/>
Nov 27 23:04:09 user nova-compute[75621]:     </input>
Nov 27 23:04:09 user nova-compute[75621]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 27 23:04:09 user nova-compute[75621]:       <listen type='address' address='0.0.0.0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </graphics>
Nov 27 23:04:09 user nova-compute[75621]:     <audio id='1' type='none'/>
Nov 27 23:04:09 user nova-compute[75621]:     <video>
Nov 27 23:04:09 user nova-compute[75621]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='video0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </video>
Nov 27 23:04:09 user nova-compute[75621]:     <memballoon model='virtio'>
Nov 27 23:04:09 user nova-compute[75621]:       <stats period='10'/>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='balloon0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:09 user nova-compute[75621]:     <rng model='virtio'>
Nov 27 23:04:09 user nova-compute[75621]:       <backend model='random'>/dev/urandom</backend>
Nov 27 23:04:09 user nova-compute[75621]:       <alias name='rng0'/>
Nov 27 23:04:09 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 23:04:09 user nova-compute[75621]:     </rng>
Nov 27 23:04:09 user nova-compute[75621]:   </devices>
Nov 27 23:04:09 user nova-compute[75621]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 23:04:09 user nova-compute[75621]:     <label>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</label>
Nov 27 23:04:09 user nova-compute[75621]:     <imagelabel>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</imagelabel>
Nov 27 23:04:09 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:09 user nova-compute[75621]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 23:04:09 user nova-compute[75621]:     <label>+64055:+108</label>
Nov 27 23:04:09 user nova-compute[75621]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 23:04:09 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:09 user nova-compute[75621]: </domain>
Nov 27 23:04:09 user nova-compute[75621]:  {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 23:04:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully detached device tap0a6e2f35-0e from instance f4db7063-348e-4c7a-97d9-1b014e453e39 from the live domain config.
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG os_vif [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6e2f35-0e, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efd66fa9-1a99-4af9-a80b-2c1258ed6d74) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:09 user nova-compute[75621]: INFO os_vif [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e')
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:09 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:04:09</nova:creationTime>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:04:09 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:owner>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:owner>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:09 user nova-compute[75621]:   <nova:ports>
Nov 27 23:04:09 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:04:09 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:04:09 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:09 user nova-compute[75621]:   </nova:ports>
Nov 27 23:04:09 user nova-compute[75621]: </nova:instance>
Nov 27 23:04:09 user nova-compute[75621]:  {{(pid=75621) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-deleted-0a6e2f35-0ea4-4277-add6-1f73f45bee02 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:09 user nova-compute[75621]: INFO nova.compute.manager [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Neutron deleted interface 0a6e2f35-0ea4-4277-add6-1f73f45bee02; detaching it from the instance and deleting it from the info cache
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquired lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.objects.instance [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Lazy-loading 'system_metadata' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.objects.instance [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Lazy-loading 'flavor' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.objects.base [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Object Instance<f4db7063-348e-4c7a-97d9-1b014e453e39> lazy-loaded attributes: system_metadata,flavor {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 27 23:04:10 user nova-compute[75621]:   <name>instance-00000008</name>
Nov 27 23:04:10 user nova-compute[75621]:   <uuid>f4db7063-348e-4c7a-97d9-1b014e453e39</uuid>
Nov 27 23:04:10 user nova-compute[75621]:   <metadata>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:10 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:04:09</nova:creationTime>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:04:10 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:ports>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:04:10 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:04:10 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:ports>
Nov 27 23:04:10 user nova-compute[75621]: </nova:instance>
Nov 27 23:04:10 user nova-compute[75621]:   </metadata>
Nov 27 23:04:10 user nova-compute[75621]:   <memory unit='KiB'>524288</memory>
Nov 27 23:04:10 user nova-compute[75621]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 23:04:10 user nova-compute[75621]:   <vcpu placement='static'>1</vcpu>
Nov 27 23:04:10 user nova-compute[75621]:   <resource>
Nov 27 23:04:10 user nova-compute[75621]:     <partition>/machine</partition>
Nov 27 23:04:10 user nova-compute[75621]:   </resource>
Nov 27 23:04:10 user nova-compute[75621]:   <sysinfo type='smbios'>
Nov 27 23:04:10 user nova-compute[75621]:     <system>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='version'>0.0.0</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='serial'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='uuid'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='family'>Virtual Machine</entry>
Nov 27 23:04:10 user nova-compute[75621]:     </system>
Nov 27 23:04:10 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:10 user nova-compute[75621]:   <os>
Nov 27 23:04:10 user nova-compute[75621]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 23:04:10 user nova-compute[75621]:     <boot dev='hd'/>
Nov 27 23:04:10 user nova-compute[75621]:     <smbios mode='sysinfo'/>
Nov 27 23:04:10 user nova-compute[75621]:   </os>
Nov 27 23:04:10 user nova-compute[75621]:   <features>
Nov 27 23:04:10 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:10 user nova-compute[75621]:     <apic/>
Nov 27 23:04:10 user nova-compute[75621]:     <vmcoreinfo state='on'/>
Nov 27 23:04:10 user nova-compute[75621]:   </features>
Nov 27 23:04:10 user nova-compute[75621]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 23:04:10 user nova-compute[75621]:     <model fallback='forbid'>Nehalem</model>
Nov 27 23:04:10 user nova-compute[75621]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='vme'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='x2apic'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='hypervisor'/>
Nov 27 23:04:10 user nova-compute[75621]:   </cpu>
Nov 27 23:04:10 user nova-compute[75621]:   <clock offset='utc'>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='hpet' present='no'/>
Nov 27 23:04:10 user nova-compute[75621]:   </clock>
Nov 27 23:04:10 user nova-compute[75621]:   <on_poweroff>destroy</on_poweroff>
Nov 27 23:04:10 user nova-compute[75621]:   <on_reboot>restart</on_reboot>
Nov 27 23:04:10 user nova-compute[75621]:   <on_crash>destroy</on_crash>
Nov 27 23:04:10 user nova-compute[75621]:   <devices>
Nov 27 23:04:10 user nova-compute[75621]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 23:04:10 user nova-compute[75621]:     <disk type='file' device='disk'>
Nov 27 23:04:10 user nova-compute[75621]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 23:04:10 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk' index='2'/>
Nov 27 23:04:10 user nova-compute[75621]:       <backingStore type='file' index='3'>
Nov 27 23:04:10 user nova-compute[75621]:         <format type='raw'/>
Nov 27 23:04:10 user nova-compute[75621]:         <source file='/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f'/>
Nov 27 23:04:10 user nova-compute[75621]:         <backingStore/>
Nov 27 23:04:10 user nova-compute[75621]:       </backingStore>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='vda' bus='virtio'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='virtio-disk0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </disk>
Nov 27 23:04:10 user nova-compute[75621]:     <disk type='file' device='cdrom'>
Nov 27 23:04:10 user nova-compute[75621]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 23:04:10 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config' index='1'/>
Nov 27 23:04:10 user nova-compute[75621]:       <backingStore/>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='hda' bus='ide'/>
Nov 27 23:04:10 user nova-compute[75621]:       <readonly/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='ide0-0-0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </disk>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='usb' index='0' model='none'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='usb'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='pci.0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='ide' index='0'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='ide'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <interface type='ethernet'>
Nov 27 23:04:10 user nova-compute[75621]:       <mac address='fa:16:3e:fe:7a:1b'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='tapd06cc534-9b'/>
Nov 27 23:04:10 user nova-compute[75621]:       <model type='virtio'/>
Nov 27 23:04:10 user nova-compute[75621]:       <mtu size='1442'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='net0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </interface>
Nov 27 23:04:10 user nova-compute[75621]:     <serial type='pty'>
Nov 27 23:04:10 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:10 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target type='isa-serial' port='0'>
Nov 27 23:04:10 user nova-compute[75621]:         <model name='isa-serial'/>
Nov 27 23:04:10 user nova-compute[75621]:       </target>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </serial>
Nov 27 23:04:10 user nova-compute[75621]:     <console type='pty' tty='/dev/pts/7'>
Nov 27 23:04:10 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:10 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target type='serial' port='0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </console>
Nov 27 23:04:10 user nova-compute[75621]:     <input type='mouse' bus='ps2'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='input0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </input>
Nov 27 23:04:10 user nova-compute[75621]:     <input type='keyboard' bus='ps2'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='input1'/>
Nov 27 23:04:10 user nova-compute[75621]:     </input>
Nov 27 23:04:10 user nova-compute[75621]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 27 23:04:10 user nova-compute[75621]:       <listen type='address' address='0.0.0.0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </graphics>
Nov 27 23:04:10 user nova-compute[75621]:     <audio id='1' type='none'/>
Nov 27 23:04:10 user nova-compute[75621]:     <video>
Nov 27 23:04:10 user nova-compute[75621]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='video0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </video>
Nov 27 23:04:10 user nova-compute[75621]:     <memballoon model='virtio'>
Nov 27 23:04:10 user nova-compute[75621]:       <stats period='10'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='balloon0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:10 user nova-compute[75621]:     <rng model='virtio'>
Nov 27 23:04:10 user nova-compute[75621]:       <backend model='random'>/dev/urandom</backend>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='rng0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </rng>
Nov 27 23:04:10 user nova-compute[75621]:   </devices>
Nov 27 23:04:10 user nova-compute[75621]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 23:04:10 user nova-compute[75621]:     <label>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</label>
Nov 27 23:04:10 user nova-compute[75621]:     <imagelabel>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</imagelabel>
Nov 27 23:04:10 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:10 user nova-compute[75621]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 23:04:10 user nova-compute[75621]:     <label>+64055:+108</label>
Nov 27 23:04:10 user nova-compute[75621]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 23:04:10 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:10 user nova-compute[75621]: </domain>
Nov 27 23:04:10 user nova-compute[75621]:  {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface> {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:8c:71:b8"/><model type="virtio"/><mtu size="1442"/><target dev="tap0a6e2f35-0e"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 27 23:04:10 user nova-compute[75621]:   <name>instance-00000008</name>
Nov 27 23:04:10 user nova-compute[75621]:   <uuid>f4db7063-348e-4c7a-97d9-1b014e453e39</uuid>
Nov 27 23:04:10 user nova-compute[75621]:   <metadata>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:10 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:04:09</nova:creationTime>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:04:10 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:ports>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:04:10 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:04:10 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:ports>
Nov 27 23:04:10 user nova-compute[75621]: </nova:instance>
Nov 27 23:04:10 user nova-compute[75621]:   </metadata>
Nov 27 23:04:10 user nova-compute[75621]:   <memory unit='KiB'>524288</memory>
Nov 27 23:04:10 user nova-compute[75621]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 27 23:04:10 user nova-compute[75621]:   <vcpu placement='static'>1</vcpu>
Nov 27 23:04:10 user nova-compute[75621]:   <resource>
Nov 27 23:04:10 user nova-compute[75621]:     <partition>/machine</partition>
Nov 27 23:04:10 user nova-compute[75621]:   </resource>
Nov 27 23:04:10 user nova-compute[75621]:   <sysinfo type='smbios'>
Nov 27 23:04:10 user nova-compute[75621]:     <system>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='product'>OpenStack Nova</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='version'>0.0.0</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='serial'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='uuid'>f4db7063-348e-4c7a-97d9-1b014e453e39</entry>
Nov 27 23:04:10 user nova-compute[75621]:       <entry name='family'>Virtual Machine</entry>
Nov 27 23:04:10 user nova-compute[75621]:     </system>
Nov 27 23:04:10 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:10 user nova-compute[75621]:   <os>
Nov 27 23:04:10 user nova-compute[75621]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 27 23:04:10 user nova-compute[75621]:     <boot dev='hd'/>
Nov 27 23:04:10 user nova-compute[75621]:     <smbios mode='sysinfo'/>
Nov 27 23:04:10 user nova-compute[75621]:   </os>
Nov 27 23:04:10 user nova-compute[75621]:   <features>
Nov 27 23:04:10 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:10 user nova-compute[75621]:     <apic/>
Nov 27 23:04:10 user nova-compute[75621]:     <vmcoreinfo state='on'/>
Nov 27 23:04:10 user nova-compute[75621]:   </features>
Nov 27 23:04:10 user nova-compute[75621]:   <cpu mode='custom' match='exact' check='full'>
Nov 27 23:04:10 user nova-compute[75621]:     <model fallback='forbid'>Nehalem</model>
Nov 27 23:04:10 user nova-compute[75621]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='vme'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='x2apic'/>
Nov 27 23:04:10 user nova-compute[75621]:     <feature policy='require' name='hypervisor'/>
Nov 27 23:04:10 user nova-compute[75621]:   </cpu>
Nov 27 23:04:10 user nova-compute[75621]:   <clock offset='utc'>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='pit' tickpolicy='delay'/>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 27 23:04:10 user nova-compute[75621]:     <timer name='hpet' present='no'/>
Nov 27 23:04:10 user nova-compute[75621]:   </clock>
Nov 27 23:04:10 user nova-compute[75621]:   <on_poweroff>destroy</on_poweroff>
Nov 27 23:04:10 user nova-compute[75621]:   <on_reboot>restart</on_reboot>
Nov 27 23:04:10 user nova-compute[75621]:   <on_crash>destroy</on_crash>
Nov 27 23:04:10 user nova-compute[75621]:   <devices>
Nov 27 23:04:10 user nova-compute[75621]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 27 23:04:10 user nova-compute[75621]:     <disk type='file' device='disk'>
Nov 27 23:04:10 user nova-compute[75621]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 27 23:04:10 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk' index='2'/>
Nov 27 23:04:10 user nova-compute[75621]:       <backingStore type='file' index='3'>
Nov 27 23:04:10 user nova-compute[75621]:         <format type='raw'/>
Nov 27 23:04:10 user nova-compute[75621]:         <source file='/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f'/>
Nov 27 23:04:10 user nova-compute[75621]:         <backingStore/>
Nov 27 23:04:10 user nova-compute[75621]:       </backingStore>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='vda' bus='virtio'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='virtio-disk0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </disk>
Nov 27 23:04:10 user nova-compute[75621]:     <disk type='file' device='cdrom'>
Nov 27 23:04:10 user nova-compute[75621]:       <driver name='qemu' type='raw' cache='none'/>
Nov 27 23:04:10 user nova-compute[75621]:       <source file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/disk.config' index='1'/>
Nov 27 23:04:10 user nova-compute[75621]:       <backingStore/>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='hda' bus='ide'/>
Nov 27 23:04:10 user nova-compute[75621]:       <readonly/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='ide0-0-0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </disk>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='usb' index='0' model='none'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='usb'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='pci' index='0' model='pci-root'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='pci.0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <controller type='ide' index='0'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='ide'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 27 23:04:10 user nova-compute[75621]:     </controller>
Nov 27 23:04:10 user nova-compute[75621]:     <interface type='ethernet'>
Nov 27 23:04:10 user nova-compute[75621]:       <mac address='fa:16:3e:fe:7a:1b'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target dev='tapd06cc534-9b'/>
Nov 27 23:04:10 user nova-compute[75621]:       <model type='virtio'/>
Nov 27 23:04:10 user nova-compute[75621]:       <mtu size='1442'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='net0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </interface>
Nov 27 23:04:10 user nova-compute[75621]:     <serial type='pty'>
Nov 27 23:04:10 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:10 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target type='isa-serial' port='0'>
Nov 27 23:04:10 user nova-compute[75621]:         <model name='isa-serial'/>
Nov 27 23:04:10 user nova-compute[75621]:       </target>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </serial>
Nov 27 23:04:10 user nova-compute[75621]:     <console type='pty' tty='/dev/pts/7'>
Nov 27 23:04:10 user nova-compute[75621]:       <source path='/dev/pts/7'/>
Nov 27 23:04:10 user nova-compute[75621]:       <log file='/opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39/console.log' append='off'/>
Nov 27 23:04:10 user nova-compute[75621]:       <target type='serial' port='0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='serial0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </console>
Nov 27 23:04:10 user nova-compute[75621]:     <input type='mouse' bus='ps2'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='input0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </input>
Nov 27 23:04:10 user nova-compute[75621]:     <input type='keyboard' bus='ps2'>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='input1'/>
Nov 27 23:04:10 user nova-compute[75621]:     </input>
Nov 27 23:04:10 user nova-compute[75621]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 27 23:04:10 user nova-compute[75621]:       <listen type='address' address='0.0.0.0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </graphics>
Nov 27 23:04:10 user nova-compute[75621]:     <audio id='1' type='none'/>
Nov 27 23:04:10 user nova-compute[75621]:     <video>
Nov 27 23:04:10 user nova-compute[75621]:       <model type='virtio' heads='1' primary='yes'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='video0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </video>
Nov 27 23:04:10 user nova-compute[75621]:     <memballoon model='virtio'>
Nov 27 23:04:10 user nova-compute[75621]:       <stats period='10'/>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='balloon0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:10 user nova-compute[75621]:     <rng model='virtio'>
Nov 27 23:04:10 user nova-compute[75621]:       <backend model='random'>/dev/urandom</backend>
Nov 27 23:04:10 user nova-compute[75621]:       <alias name='rng0'/>
Nov 27 23:04:10 user nova-compute[75621]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 27 23:04:10 user nova-compute[75621]:     </rng>
Nov 27 23:04:10 user nova-compute[75621]:   </devices>
Nov 27 23:04:10 user nova-compute[75621]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 27 23:04:10 user nova-compute[75621]:     <label>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</label>
Nov 27 23:04:10 user nova-compute[75621]:     <imagelabel>libvirt-f4db7063-348e-4c7a-97d9-1b014e453e39</imagelabel>
Nov 27 23:04:10 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:10 user nova-compute[75621]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 27 23:04:10 user nova-compute[75621]:     <label>+64055:+108</label>
Nov 27 23:04:10 user nova-compute[75621]:     <imagelabel>+64055:+108</imagelabel>
Nov 27 23:04:10 user nova-compute[75621]:   </seclabel>
Nov 27 23:04:10 user nova-compute[75621]: </domain>
Nov 27 23:04:10 user nova-compute[75621]:  {{(pid=75621) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 27 23:04:10 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Detaching interface fa:16:3e:8c:71:b8 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap0a6e2f35-0e' not found.
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.network.os_vif_util [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Converting VIF {"id": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "address": "fa:16:3e:8c:71:b8", "network": {"id": "6055085c-423a-42ec-9e80-125909d20b1c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-915165771", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a6e2f35-0e", "ovs_interfaceid": "0a6e2f35-0ea4-4277-add6-1f73f45bee02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.network.os_vif_util [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG os_vif [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a6e2f35-0e, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:10 user nova-compute[75621]: INFO os_vif [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:71:b8,bridge_name='br-int',has_traffic_filtering=True,id=0a6e2f35-0ea4-4277-add6-1f73f45bee02,network=Network(6055085c-423a-42ec-9e80-125909d20b1c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a6e2f35-0e')
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [req-223d1ff7-e8af-4bb8-83e4-da0ecde184a4 req-37065f1f-41d8-4b96-b253-08f4c40b2219 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:10 user nova-compute[75621]:   <nova:package version="0.0.0"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:name>tempest-device-tagging-server-82250249</nova:name>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:creationTime>2023-11-27 23:04:10</nova:creationTime>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:flavor name="m1.tiny">
Nov 27 23:04:10 user nova-compute[75621]:     <nova:memory>512</nova:memory>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:disk>1</nova:disk>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:swap>0</nova:swap>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:flavor>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:user uuid="933ec913fbde47aa90a41d1e7d74d99d">tempest-TaggedAttachmentsTest-1139342585-project-member</nova:user>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:project uuid="301d1c9794924637ba360f1c18ffc585">tempest-TaggedAttachmentsTest-1139342585</nova:project>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:owner>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:10 user nova-compute[75621]:   <nova:ports>
Nov 27 23:04:10 user nova-compute[75621]:     <nova:port uuid="d06cc534-9b80-4b4a-98b6-7e45fc79b89d">
Nov 27 23:04:10 user nova-compute[75621]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:04:10 user nova-compute[75621]:     </nova:port>
Nov 27 23:04:10 user nova-compute[75621]:   </nova:ports>
Nov 27 23:04:10 user nova-compute[75621]: </nova:instance>
Nov 27 23:04:10 user nova-compute[75621]:  {{(pid=75621) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:10 user nova-compute[75621]: WARNING nova.compute.manager [req-de9c52d5-8946-46dc-9997-1052dbd26802 req-dbeb0489-dea3-4e6b-981e-bf076e02868a service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state building and task_state spawning.
Nov 27 23:04:10 user nova-compute[75621]: INFO nova.network.neutron [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Port 0a6e2f35-0ea4-4277-add6-1f73f45bee02 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 27 23:04:10 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [{"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Releasing lock "refresh_cache-f4db7063-348e-4c7a-97d9-1b014e453e39" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a4c415be-a240-485f-8ed0-ed444452f1f4 tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "interface-f4db7063-348e-4c7a-97d9-1b014e453e39-0a6e2f35-0ea4-4277-add6-1f73f45bee02" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.503s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:04:12 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance spawned successfully.
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:12 user nova-compute[75621]: INFO nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:12 user nova-compute[75621]: WARNING nova.compute.manager [req-80682c7b-3a64-4449-87f7-32347e84200b req-0a029b08-5594-4196-a1e1-ebe6f75be801 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state building and task_state spawning.
Nov 27 23:04:12 user nova-compute[75621]: INFO nova.compute.manager [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Took 18.43 seconds to build instance.
Nov 27 23:04:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2ce080e6-6ad5-4a5d-bda2-de9ae9206632 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.527s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:16 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:04:16 user nova-compute[75621]: INFO nova.compute.claims [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Claim successful on node user
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:04:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.policy [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '84427eb8d68248c0ba849904dc3cbb27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6d33d270e0a49cba0e556853f679e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:04:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Creating image(s)
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "/opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "/opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "/opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk 1073741824" returned: 0 in 0.052s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Successfully created port: 3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Cannot resize image /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Ensure instance console log exists: /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Successfully updated port: 3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquired lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received event network-changed-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Refreshing instance network info cache due to event network-changed-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] Acquiring lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Updating instance_info_cache with network_info: [{"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Releasing lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Instance network_info: |[{"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] Acquired lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Refreshing network info cache for port 3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Start _get_guest_xml network_info=[{"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:04:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2078187981',display_name='tempest-VolumesAdminNegativeTest-server-2078187981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2078187981',id=13,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-x4kn4f4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:17Z,user_data=None,user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=52b096b8-1aab-494d-a4eb-becbf8313dd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'pci_devices' on Instance uuid 52b096b8-1aab-494d-a4eb-becbf8313dd3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:04:19 user nova-compute[75621]:   <uuid>52b096b8-1aab-494d-a4eb-becbf8313dd3</uuid>
Nov 27 23:04:19 user nova-compute[75621]:   <name>instance-0000000d</name>
Nov 27 23:04:19 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:04:19 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:04:19 user nova-compute[75621]:   <metadata>
Nov 27 23:04:19 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:19 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2078187981</nova:name>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:04:18</nova:creationTime>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:04:19 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:19 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:owner>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:user uuid="84427eb8d68248c0ba849904dc3cbb27">tempest-VolumesAdminNegativeTest-660006676-project-member</nova:user>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:project uuid="a6d33d270e0a49cba0e556853f679e5f">tempest-VolumesAdminNegativeTest-660006676</nova:project>
Nov 27 23:04:19 user nova-compute[75621]:       </nova:owner>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:19 user nova-compute[75621]:       <nova:ports>
Nov 27 23:04:19 user nova-compute[75621]:         <nova:port uuid="3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b">
Nov 27 23:04:19 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 23:04:19 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:19 user nova-compute[75621]:       </nova:ports>
Nov 27 23:04:19 user nova-compute[75621]:     </nova:instance>
Nov 27 23:04:19 user nova-compute[75621]:   </metadata>
Nov 27 23:04:19 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:04:19 user nova-compute[75621]:     <system>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="serial">52b096b8-1aab-494d-a4eb-becbf8313dd3</entry>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="uuid">52b096b8-1aab-494d-a4eb-becbf8313dd3</entry>
Nov 27 23:04:19 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:04:19 user nova-compute[75621]:     </system>
Nov 27 23:04:19 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:19 user nova-compute[75621]:   <os>
Nov 27 23:04:19 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:04:19 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:04:19 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:04:19 user nova-compute[75621]:   </os>
Nov 27 23:04:19 user nova-compute[75621]:   <features>
Nov 27 23:04:19 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:19 user nova-compute[75621]:     <apic/>
Nov 27 23:04:19 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:04:19 user nova-compute[75621]:   </features>
Nov 27 23:04:19 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:04:19 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:04:19 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:04:19 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:04:19 user nova-compute[75621]:   </clock>
Nov 27 23:04:19 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:04:19 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:04:19 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:04:19 user nova-compute[75621]:   </cpu>
Nov 27 23:04:19 user nova-compute[75621]:   <devices>
Nov 27 23:04:19 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:04:19 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:04:19 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk"/>
Nov 27 23:04:19 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:04:19 user nova-compute[75621]:     </disk>
Nov 27 23:04:19 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:19 user nova-compute[75621]:       <mac address="fa:16:3e:b7:9e:e0"/>
Nov 27 23:04:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:19 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:19 user nova-compute[75621]:       <target dev="tap3c8bc8e6-50"/>
Nov 27 23:04:19 user nova-compute[75621]:     </interface>
Nov 27 23:04:19 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:04:19 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/console.log" append="off"/>
Nov 27 23:04:19 user nova-compute[75621]:     </serial>
Nov 27 23:04:19 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:04:19 user nova-compute[75621]:     <video>
Nov 27 23:04:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:19 user nova-compute[75621]:     </video>
Nov 27 23:04:19 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:04:19 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:04:19 user nova-compute[75621]:     </rng>
Nov 27 23:04:19 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:04:19 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:04:19 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:04:19 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:19 user nova-compute[75621]:   </devices>
Nov 27 23:04:19 user nova-compute[75621]: </domain>
Nov 27 23:04:19 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2078187981',display_name='tempest-VolumesAdminNegativeTest-server-2078187981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2078187981',id=13,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-x4kn4f4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:17Z,user_data=None,user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=52b096b8-1aab-494d-a4eb-becbf8313dd3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG os_vif [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e05df4ea-9367-5acc-b209-0032b47c0650', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c8bc8e6-50, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3c8bc8e6-50, col_values=(('qos', UUID('5f67bf55-2f7f-4802-a52e-7f1005c48409')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3c8bc8e6-50, col_values=(('external_ids', {'iface-id': '3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:9e:e0', 'vm-uuid': '52b096b8-1aab-494d-a4eb-becbf8313dd3'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: INFO os_vif [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50')
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] No VIF found with MAC fa:16:3e:b7:9e:e0, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Updated VIF entry in instance network info cache for port 3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Updating instance_info_cache with network_info: [{"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ddfa430f-94b4-49f1-8a09-d38de8d3f34f req-b3807de4-be8a-4e99-82da-8047de815fc5 service nova] Releasing lock "refresh_cache-52b096b8-1aab-494d-a4eb-becbf8313dd3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:19 user nova-compute[75621]: INFO nova.compute.manager [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Terminating instance
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-unplugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] No waiting events found dispatching network-vif-unplugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-7877f2e8-4925-4fae-8853-5e1eda1b0cd2 req-efb643d7-a6c9-4f59-b48a-e17097e84184 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-unplugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:04:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Instance destroyed successfully.
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lazy-loading 'resources' on Instance uuid 521810a6-88ad-46c0-b73c-d77f6b26a66e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1127206070',display_name='tempest-VolumesActionsTest-instance-1127206070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1127206070',id=11,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:02:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c5a4463276244c1b9138b190e65d9e1',ramdisk_id='',reservation_id='r-eyt710x1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1694988353',owner_user_name='tempest-VolumesActionsTest-1694988353-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:30Z,user_data=None,user_id='d2f1941d34224041bbbfd15a08301b6d',uuid=521810a6-88ad-46c0-b73c-d77f6b26a66e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converting VIF {"id": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "address": "fa:16:3e:c1:80:8f", "network": {"id": "7248e36e-1a2a-4b5c-ac74-88cae63ac589", "bridge": "br-int", "label": "tempest-VolumesActionsTest-777461427-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c5a4463276244c1b9138b190e65d9e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cadc9ba-50", "ovs_interfaceid": "3cadc9ba-5002-4db6-ae38-6fb516f9dfe8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG os_vif [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cadc9ba-50, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c3b90e5-5728-4b81-97b8-f07df1d2c060) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:20 user nova-compute[75621]: INFO os_vif [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:80:8f,bridge_name='br-int',has_traffic_filtering=True,id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8,network=Network(7248e36e-1a2a-4b5c-ac74-88cae63ac589),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cadc9ba-50')
Nov 27 23:04:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Deleting instance files /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e_del
Nov 27 23:04:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Deletion of /opt/stack/data/nova/instances/521810a6-88ad-46c0-b73c-d77f6b26a66e_del complete
Nov 27 23:04:20 user nova-compute[75621]: INFO nova.compute.manager [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 27 23:04:20 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:04:20 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received event network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] Acquiring lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] No waiting events found dispatching network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:21 user nova-compute[75621]: WARNING nova.compute.manager [req-66b4dfc6-dab2-4593-8769-cb8a9b89ea90 req-2bb87f56-60f9-4c4f-8230-f91e03ee1915 service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received unexpected event network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b for instance with vm_state building and task_state spawning.
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:21 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Took 0.43 seconds to deallocate network for instance.
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-0425d35f-1b16-43be-acf3-942680263802 req-7e47688b-31d2-47b5-a15e-4286e55c53be service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-deleted-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:21 user nova-compute[75621]: INFO nova.compute.manager [req-0425d35f-1b16-43be-acf3-942680263802 req-7e47688b-31d2-47b5-a15e-4286e55c53be service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Neutron deleted interface 3cadc9ba-5002-4db6-ae38-6fb516f9dfe8; detaching it from the instance and deleting it from the info cache
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-0425d35f-1b16-43be-acf3-942680263802 req-7e47688b-31d2-47b5-a15e-4286e55c53be service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-0425d35f-1b16-43be-acf3-942680263802 req-7e47688b-31d2-47b5-a15e-4286e55c53be service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Detach interface failed, port_id=3cadc9ba-5002-4db6-ae38-6fb516f9dfe8, reason: Instance 521810a6-88ad-46c0-b73c-d77f6b26a66e could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:21 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Deleted allocations for instance 521810a6-88ad-46c0-b73c-d77f6b26a66e
Nov 27 23:04:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-623def3d-d2ed-48b7-b018-eebad447a9c9 tempest-VolumesActionsTest-1694988353 tempest-VolumesActionsTest-1694988353-project-member] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.444s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] Acquiring lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] Lock "521810a6-88ad-46c0-b73c-d77f6b26a66e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] No waiting events found dispatching network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:22 user nova-compute[75621]: WARNING nova.compute.manager [req-95e1eb7d-19f8-4582-b7a2-267763af47b8 req-35dc015e-7228-463d-9259-d1f1753ee838 service nova] [instance: 521810a6-88ad-46c0-b73c-d77f6b26a66e] Received unexpected event network-vif-plugged-3cadc9ba-5002-4db6-ae38-6fb516f9dfe8 for instance with vm_state deleted and task_state None.
Nov 27 23:04:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:04:23 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Instance spawned successfully.
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:23 user nova-compute[75621]: INFO nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received event network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] Acquiring lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] No waiting events found dispatching network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:23 user nova-compute[75621]: WARNING nova.compute.manager [req-72322422-f3d5-4bf9-8678-e95df3376ef1 req-d19360d9-920d-42a7-bc65-f5a44fe4e3ed service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received unexpected event network-vif-plugged-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b for instance with vm_state building and task_state spawning.
Nov 27 23:04:23 user nova-compute[75621]: INFO nova.compute.manager [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Took 6.56 seconds to build instance.
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3fc7f217-90d2-4a65-b229-3b2f6f3112b5 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.691s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:04:23 user nova-compute[75621]: INFO nova.compute.claims [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Claim successful on node user
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:04:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:04:24 user nova-compute[75621]: INFO nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Booting with volume 9bb736b2-15c9-4074-a468-052dedf8fdef at /dev/vda
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.policy [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c012c6799710443c938fb052e6f06a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86b7693a0b2b447e944fc201f80241a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed7f73a-0dd7-419f-83e1-dcdc4763a967]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce43952f-8a5b-42b7-88df-fde84d51f4cd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e40df2-c26a-4ed1-ae2f-ef1ecf57c1fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30f9c0b-358c-4c0f-8de7-d0487cdc7ec4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:24 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6cbd09-3861-4ea0-8426-97cf48df5833]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating existing volume attachment record: 1d0d20db-8136-4f59-9009-7d4b01298f81 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:04:24 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully created port: 27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully created port: 7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:25 user nova-compute[75621]: INFO nova.compute.manager [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Terminating instance
Nov 27 23:04:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-unplugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] No waiting events found dispatching network-vif-unplugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-db3becec-2589-4f86-9fd7-f4f28d5086fb req-9e06ab49-1646-4b04-b3ab-9ebbf13113fb service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-unplugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:04:26 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Instance destroyed successfully.
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.objects.instance [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lazy-loading 'resources' on Instance uuid dfdff3c7-4ea4-4c11-a737-71c46c844fce {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-132050560',display_name='tempest-VolumesAssistedSnapshotsTest-server-132050560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-132050560',id=9,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEKO6toZMIfUyKy35Z6ZfHvrQt6hTGy2HHTe5egO06jRlAOCrC7fBWzrKcRx0II6tpsc07B0ekPFA/Sa7LqI/a9WEzz/PbV6RNLDPTODyBLMiOrHwzhMXZOvM6c9cZhcJQ==',key_name='tempest-keypair-244360235',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='76a0b768ae50496690b977b4c5f03a56',ramdisk_id='',reservation_id='r-9ny01y22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1157325062',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1157325062-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fc820bbd0de4e80a3ea40a55bab9e31',uuid=dfdff3c7-4ea4-4c11-a737-71c46c844fce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converting VIF {"id": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "address": "fa:16:3e:05:dd:4f", "network": {"id": "a7070440-318e-43cf-ad9c-fbbdb26ad6f4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1270538288-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "76a0b768ae50496690b977b4c5f03a56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde498b21-1f", "ovs_interfaceid": "de498b21-1fbc-4b3c-946c-4a1e5de6d392", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG os_vif [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde498b21-1f, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f869a1e-74b7-4e7c-a900-512da209b77d) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:26 user nova-compute[75621]: INFO os_vif [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:dd:4f,bridge_name='br-int',has_traffic_filtering=True,id=de498b21-1fbc-4b3c-946c-4a1e5de6d392,network=Network(a7070440-318e-43cf-ad9c-fbbdb26ad6f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde498b21-1f')
Nov 27 23:04:26 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Deleting instance files /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce_del
Nov 27 23:04:26 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Deletion of /opt/stack/data/nova/instances/dfdff3c7-4ea4-4c11-a737-71c46c844fce_del complete
Nov 27 23:04:26 user nova-compute[75621]: INFO nova.compute.manager [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 27 23:04:26 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:04:26 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully created port: 069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:27 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:27 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Took 1.12 seconds to deallocate network for instance.
Nov 27 23:04:27 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully created port: 18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-81f4dab0-087d-4d79-95f7-1a843532f96d req-31e40e40-aa8a-4772-88e0-e70c855ca6e6 service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-deleted-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] Acquiring lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] No waiting events found dispatching network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:28 user nova-compute[75621]: WARNING nova.compute.manager [req-8b4f7a2f-34f9-4954-b49a-4c89df4a03cf req-da37114e-d854-449a-9b49-1cb9bfe31195 service nova] [instance: dfdff3c7-4ea4-4c11-a737-71c46c844fce] Received unexpected event network-vif-plugged-de498b21-1fbc-4b3c-946c-4a1e5de6d392 for instance with vm_state deleted and task_state None.
Nov 27 23:04:28 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:28 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Deleted allocations for instance dfdff3c7-4ea4-4c11-a737-71c46c844fce
Nov 27 23:04:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-65d731e3-306c-4d93-9700-8cf612ce6be5 tempest-VolumesAssistedSnapshotsTest-1157325062 tempest-VolumesAssistedSnapshotsTest-1157325062-project-member] Lock "dfdff3c7-4ea4-4c11-a737-71c46c844fce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.912s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully created port: 0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-27cd43be-7423-4cda-ba31-f7a17e03f6ee. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-736454d0-8f18-4349-badb-07ef7fc50e04 req-a1a140d4-13d2-411f-b946-eee0e4172af5 service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:32 user nova-compute[75621]: INFO nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Booting with volume b0fd4c35-4264-42b3-a76a-0a506cac4681 at /dev/vdb
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-24e9c835-932d-457a-9d46-7dde72d964df. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86e8a3-4ccf-43f7-86f7-37ae1acbedfc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b85c33-5fdf-4a05-91c2-0156c3ed2123]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b796e2f-d68d-4c82-bd4a-3b7f29e07059]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c493293-9a0a-4ce2-81db-5c360098c3b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:32 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed082602-39c3-429e-97e1-16b7d5adea0c]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating existing volume attachment record: abd8c09c-a6ca-4d81-98e4-4e0380944234 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-7ef8ac6f-fa30-47cf-acdb-7c2377b15192. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Successfully updated port: 0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-069bee22-5acb-47ee-b58d-61642f7313ab. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68dbb1e2-69cc-4b4e-a765-f9e4151d7658 req-97336ebf-54a9-4490-9339-47aaf159260f service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-18d1ecf2-c45c-4910-9633-0c089367122d. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:35 user nova-compute[75621]: DEBUG nova.network.neutron [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:35 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance network_info: |[{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:04:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:35 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updated VIF entry in instance network info cache for port 18d1ecf2-c45c-4910-9633-0c089367122d. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-0d7addf1-53ea-4f62-8d7e-5654c5e02578. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:36 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'flavor' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updated VIF entry in instance network info cache for port 0d7addf1-53ea-4f62-8d7e-5654c5e02578. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-775ab52f-269b-4719-b921-d9688cc8fa5b req-7ff9106b-9a52-4414-b2cc-a0026d278df4 service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:37 user nova-compute[75621]: INFO nova.compute.manager [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Attaching volume 4203dc00-ff03-4099-ad7d-021d6c07a20a to /dev/vdb
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.utils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[96630193-9dd5-4939-9d49-b181cd173fad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af4f6b1-cca2-444b-b787-4b9b1016e03c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d8fe9-94b2-4ca3-a5c6-ecca6d3ab772]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c6d97d-f6c0-4ffa-ad11-96e98bd65c19]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:37 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813f3b1-7339-471c-ab71-932d31f4b473]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG os_brick.utils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:37 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating existing volume attachment record: 678be5e1-0064-4d62-bfd8-664eaa815130 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:04:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:39 user nova-compute[75621]: INFO nova.compute.manager [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Terminating instance
Nov 27 23:04:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: INFO nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Booting with volume eee7749b-be40-4ef4-ac4c-afc46c3bdf37 at /dev/vdc
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e031ed7-5c5e-4a57-bfc8-ac054a343f52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[263a6645-533e-4997-ab22-fae3cf3cd77a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-unplugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-unplugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-9adc4293-c8c8-4559-b56f-63038f81f020 req-57cb756b-4bfa-4e1f-a408-1051a1baf043 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-unplugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[497c04ea-a807-4227-978c-5667ab2247af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0473ac63-f73e-4865-b633-c9277f30356c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:40 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2a77b-f682-4820-aa1d-b9a4cd836a62]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_brick.utils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating existing volume attachment record: 41cd6769-35d9-49ed-b5eb-11448910fcaf {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:04:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Instance destroyed successfully.
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lazy-loading 'resources' on Instance uuid f4db7063-348e-4c7a-97d9-1b014e453e39 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:01:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-82250249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-82250249',id=8,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNsaqrelL4G21n9ynLGsaNrsMBHliyKSgG6DOblG3ivpbGxD4AAJCT/ayEcvju6pH9gfQ1uCna5jRWXMtY7c/0iWO+/5tOVHncAxNelqmCHHc87ZI9U2UmRZ17C5/ihSA==',key_name='tempest-keypair-1424007493',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='301d1c9794924637ba360f1c18ffc585',ramdisk_id='',reservation_id='r-uayjhpo4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1139342585',owner_user_name='tempest-TaggedAttachmentsTest-1139342585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='933ec913fbde47aa90a41d1e7d74d99d',uuid=f4db7063-348e-4c7a-97d9-1b014e453e39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converting VIF {"id": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "address": "fa:16:3e:fe:7a:1b", "network": {"id": "c86b7e85-722e-43ba-99c8-316003166394", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-480581151-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "301d1c9794924637ba360f1c18ffc585", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd06cc534-9b", "ovs_interfaceid": "d06cc534-9b80-4b4a-98b6-7e45fc79b89d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG os_vif [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd06cc534-9b, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6bd3b067-94e5-49c8-9de6-cd20eceec4f1) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:40 user nova-compute[75621]: INFO os_vif [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:7a:1b,bridge_name='br-int',has_traffic_filtering=True,id=d06cc534-9b80-4b4a-98b6-7e45fc79b89d,network=Network(c86b7e85-722e-43ba-99c8-316003166394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd06cc534-9b')
Nov 27 23:04:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Deleting instance files /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39_del
Nov 27 23:04:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Deletion of /opt/stack/data/nova/instances/f4db7063-348e-4c7a-97d9-1b014e453e39_del complete
Nov 27 23:04:40 user nova-compute[75621]: INFO nova.compute.manager [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:04:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:04:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:04:42 user nova-compute[75621]: INFO nova.compute.claims [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Claim successful on node user
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:42 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Took 1.52 seconds to deallocate network for instance.
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-fa11d0e3-10df-4d4e-8661-96fa75061e4b req-5f913bb8-e888-4d54-a2f5-aad234b6f96e service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-deleted-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.080s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:04:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] Acquiring lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] No waiting events found dispatching network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:42 user nova-compute[75621]: WARNING nova.compute.manager [req-645076b5-a65b-4144-86b6-11a1a5db6cb4 req-8ec1c900-450a-462e-9761-1959451e8060 service nova] [instance: f4db7063-348e-4c7a-97d9-1b014e453e39] Received unexpected event network-vif-plugged-d06cc534-9b80-4b4a-98b6-7e45fc79b89d for instance with vm_state deleted and task_state None.
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:04:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Creating image(s)
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.069s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.policy [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4cbbd5877014527889b23cd592da5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af3c98f53504bd39917790819b9bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:43 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Deleted allocations for instance f4db7063-348e-4c7a-97d9-1b014e453e39
Nov 27 23:04:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2221aa25-5d5a-473e-a30d-29a1884cd62c tempest-TaggedAttachmentsTest-1139342585 tempest-TaggedAttachmentsTest-1139342585-project-member] Lock "f4db7063-348e-4c7a-97d9-1b014e453e39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.339s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk 1073741824" returned: 0 in 0.047s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Cannot resize image /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Ensure instance console log exists: /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Successfully created port: 4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Successfully updated port: 4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-changed-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Refreshing instance network info cache due to event network-changed-4a4ff5fc-0b77-4dba-b146-0ae201275cb9. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] Acquiring lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:45 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b784907-11d4-4ca5-9d67-20b9c436e715]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:45 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[758029d9-4e26-43d0-b286-3f07c18ad509]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[994aaba1-2bfc-4feb-9e24-895d992471c6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91dc7f3-8079-47fc-aa24-24236ed31453]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da9e770-4964-4eba-a828-797b7ba70656]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcTuhSKy'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ac1a3-c452-4f10-993c-32d6b6d3b68e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6d8b9f-4016-4e3c-a3b3-eb2cb7a9596c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c439f945-30f7-4993-8b21-249efd853ee3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:04:45 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[697eb401-368e-45f4-bd39-351536cee6a3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eefc9f-0c96-4239-a4de-7ec8d0c6c33d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:45 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating instance_info_cache with network_info: [{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e6218c-08a1-4144-b5f3-b63c61744dd1]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance network_info: |[{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] Acquired lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Refreshing network info cache for port 4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start _get_guest_xml network_info=[{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:04:45 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:45 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-tempest.common.compute-instance-523009238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.objects.instance [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'pci_devices' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:04:45 user nova-compute[75621]:   <uuid>ee90a2b7-403e-46ae-ab6b-a1caf604a98b</uuid>
Nov 27 23:04:45 user nova-compute[75621]:   <name>instance-0000000f</name>
Nov 27 23:04:45 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:04:45 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:04:45 user nova-compute[75621]:   <metadata>
Nov 27 23:04:45 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:45 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:name>tempest-tempest.common.compute-instance-523009238</nova:name>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:04:45</nova:creationTime>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:04:45 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:45 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:owner>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:user uuid="d4cbbd5877014527889b23cd592da5f0">tempest-ServerActionsTestOtherA-1166847266-project-member</nova:user>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:project uuid="7af3c98f53504bd39917790819b9bae6">tempest-ServerActionsTestOtherA-1166847266</nova:project>
Nov 27 23:04:45 user nova-compute[75621]:       </nova:owner>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:45 user nova-compute[75621]:       <nova:ports>
Nov 27 23:04:45 user nova-compute[75621]:         <nova:port uuid="4a4ff5fc-0b77-4dba-b146-0ae201275cb9">
Nov 27 23:04:45 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:04:45 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:45 user nova-compute[75621]:       </nova:ports>
Nov 27 23:04:45 user nova-compute[75621]:     </nova:instance>
Nov 27 23:04:45 user nova-compute[75621]:   </metadata>
Nov 27 23:04:45 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:04:45 user nova-compute[75621]:     <system>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="serial">ee90a2b7-403e-46ae-ab6b-a1caf604a98b</entry>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="uuid">ee90a2b7-403e-46ae-ab6b-a1caf604a98b</entry>
Nov 27 23:04:45 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:04:45 user nova-compute[75621]:     </system>
Nov 27 23:04:45 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:45 user nova-compute[75621]:   <os>
Nov 27 23:04:45 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:04:45 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:04:45 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:04:45 user nova-compute[75621]:   </os>
Nov 27 23:04:45 user nova-compute[75621]:   <features>
Nov 27 23:04:45 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:45 user nova-compute[75621]:     <apic/>
Nov 27 23:04:45 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:04:45 user nova-compute[75621]:   </features>
Nov 27 23:04:45 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:04:45 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:04:45 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:04:45 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:04:45 user nova-compute[75621]:   </clock>
Nov 27 23:04:45 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:04:45 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:04:45 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:04:45 user nova-compute[75621]:   </cpu>
Nov 27 23:04:45 user nova-compute[75621]:   <devices>
Nov 27 23:04:45 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:04:45 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:04:45 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk"/>
Nov 27 23:04:45 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:04:45 user nova-compute[75621]:     </disk>
Nov 27 23:04:45 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:45 user nova-compute[75621]:       <mac address="fa:16:3e:c3:51:c7"/>
Nov 27 23:04:45 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:45 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:45 user nova-compute[75621]:       <target dev="tap4a4ff5fc-0b"/>
Nov 27 23:04:45 user nova-compute[75621]:     </interface>
Nov 27 23:04:45 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:04:45 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/console.log" append="off"/>
Nov 27 23:04:45 user nova-compute[75621]:     </serial>
Nov 27 23:04:45 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:04:45 user nova-compute[75621]:     <video>
Nov 27 23:04:45 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:45 user nova-compute[75621]:     </video>
Nov 27 23:04:45 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:04:45 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:04:45 user nova-compute[75621]:     </rng>
Nov 27 23:04:45 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:04:45 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:04:45 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:04:45 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:45 user nova-compute[75621]:   </devices>
Nov 27 23:04:45 user nova-compute[75621]: </domain>
Nov 27 23:04:45 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-tempest.common.compute-instance-523009238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG os_vif [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9863052d-4cdd-5358-b321-ff2ce0315814', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a4ff5fc-0b, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a4ff5fc-0b, col_values=(('qos', UUID('3428f29e-e570-44c3-8ad1-28a7e2f267ac')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a4ff5fc-0b, col_values=(('external_ids', {'iface-id': '4a4ff5fc-0b77-4dba-b146-0ae201275cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:51:c7', 'vm-uuid': 'ee90a2b7-403e-46ae-ab6b-a1caf604a98b'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:45 user nova-compute[75621]: INFO os_vif [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b')
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:c3:51:c7, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updated VIF entry in instance network info cache for port 4a4ff5fc-0b77-4dba-b146-0ae201275cb9. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating instance_info_cache with network_info: [{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4efcda5-6f39-4826-a61d-c891c961cdbf req-f185d722-a46a-48ed-9a93-f3480e5d3877 service nova] Releasing lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG nova.objects.instance [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'flavor' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:04:46 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:46 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:04:46 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:04:46 user nova-compute[75621]:   <serial>4203dc00-ff03-4099-ad7d-021d6c07a20a</serial>
Nov 27 23:04:46 user nova-compute[75621]: </disk>
Nov 27 23:04:46 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No VIF found with MAC fa:16:3e:c7:38:3e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-56c8fd60-0b6c-4e38-b6df-a20c88e65d6a tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.287s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:47 user nova-compute[75621]: WARNING nova.compute.manager [req-a3f949f9-8a62-4490-8474-de10eae279d3 req-64e56561-0004-4773-ade1-9ed5708789eb service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state building and task_state spawning.
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:04:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Creating image(s)
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Ensure instance console log exists: /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Start _get_guest_xml network_info=[{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '1d0d20db-8136-4f59-9009-7d4b01298f81', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOGlrwXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe93184-5f27-493e-a456-3606f33f5c23', 'attached_at': '', 'detached_at': '', 'volume_id': '9bb736b2-15c9-4074-a468-052dedf8fdef', 'serial': '9bb736b2-15c9-4074-a468-052dedf8fdef'}, 'volume_type': None}, {'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'abd8c09c-a6ca-4d81-98e4-4e0380944234', 'delete_on_termination': False, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCADVBHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe93184-5f27-493e-a456-3606f33f5c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0fd4c35-4264-42b3-a76a-0a506cac4681', 'serial': 'b0fd4c35-4264-42b3-a76a-0a506cac4681'}, 'volume_type': None}, {'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '41cd6769-35d9-49ed-b5eb-11448910fcaf', 'delete_on_termination': False, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxViRKvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1fe93184-5f27-493e-a456-3606f33f5c23', 'attached_at': '', 'detached_at': '', 'volume_id': 'eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 'serial': 'eee7749b-be40-4ef4-ac4c-afc46c3bdf37'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:04:48 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:48 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOGlrwXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:49 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:49 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:49 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff3b86c-561a-477b-ac5c-0cd53def9b30]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:49 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[794893ab-b447-44fd-8a43-a8dedd3c1eea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef] added
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f81804-f043-4abd-a259-df3c054748d8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed2269a-1b91-42a8-86aa-7b7785ce505e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOGlrwXM {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VOGlrwXM" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[784d0b43-42f2-4131-9c00-d0d0815792f5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VOGlrwXM'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2beb87aa-201e-4973-a5da-607b6c76a469]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fe996-339a-4d5b-a703-b45673570cb7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c383a5-ff07-4e94-bff1-421172629c94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260]
Nov 27 23:04:49 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21a91f1-2d9a-48da-9128-1a0d2f919635]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca01983-ce9f-4891-a298-e7517a780061]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:49 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3509a6e1-9b4a-4503-9d52-8ccb6cd75349]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'info_cache' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:50 user nova-compute[75621]: WARNING nova.compute.manager [req-be2844ce-3ac3-4b53-ab47-635b697b933e req-cb755833-6b6e-4ca3-93aa-2e51709bdd7c service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state building and task_state spawning.
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Stashing vm_state: active {{(pid=75621) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.claims [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Claim successful on node user
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating resource usage from migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance spawned successfully.
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOGlrwXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23430643965633732', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430643965633732', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCADVBHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:50 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d225a-6a41-41a6-aa80-ee9802a77dbe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Took 7.86 seconds to spawn the instance on the hypervisor.
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:50 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7d1884-f59e-4b4f-bd50-f9c6b1460e63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681] added
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[399019b5-e0c6-4b16-a1c2-974c5ce53733]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[753d7544-2144-43d5-af9a-6b2a35648076]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCADVBHG {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tCADVBHG" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52be2e67-0171-4b05-b8c9-67330a12a928]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tCADVBHG'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.manager [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Took 8.70 seconds to build instance.
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216eefa-b734-4abf-af9d-5f6f850dd8ce]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9e56ce11-63f8-4a25-83c4-dd31d433ff32 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.827s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b0fe57-8293-4b55-85e8-31a65802d06d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae7c7f0-566e-4f5e-8a5e-87a3d91c0ca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260]
Nov 27 23:04:50 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.700s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.manager [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Migrating
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e4f28-3a01-4063-b444-ffbf18e5e4d5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:50 user nova-compute[75621]: INFO nova.compute.rpcapi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[101515e2-c154-4e91-816e-5ac5258e240f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.462s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcd8a45-7dc9-45b2-a494-3f0387ca69cb]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.network.neutron [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCADVBHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance destroyed successfully.
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'resources' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG os_vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b9f496e-43, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ead1257-6a1e-4117-ae32-a384cd19220e) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:51 user nova-compute[75621]: INFO os_vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.network.neutron [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Starting migrate_disk_and_power_off {{(pid=75621) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:04:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.552s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== connect_volume: return (1554ms) {'type': 'block', 'scsi_wwn': '23937396139336661', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937396139336661', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.743s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[192fdc15-15fd-47e1-9a2e-2cc909fdb108]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:04:52 user nova-compute[75621]: No targets found.
Nov 27 23:04:52 user nova-compute[75621]: iSNS:
Nov 27 23:04:52 user nova-compute[75621]: No targets found.
Nov 27 23:04:52 user nova-compute[75621]: STATIC:
Nov 27 23:04:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:04:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:04:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:04:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681
Nov 27 23:04:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef
Nov 27 23:04:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:52 user nova-compute[75621]: FIRMWARE:
Nov 27 23:04:52 user nova-compute[75621]: No targets found.
Nov 27 23:04:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:04:52 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:04:52 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxViRKvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa19506-3260-4a8f-821d-76c9d94c4ccb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[81606886-6332-4f55-8509-29f8b11181b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07809d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c5deca-ef2e-42f5-9abd-2fc07ab89069]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[518a2c8b-1255-4d6e-b6fc-0027c591d0a3]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b2766-9f45-4ab6-9826-3b1a7b3284c7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.060s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82a7577-fe4a-424f-8a2b-33b3be8c256e]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacb74b6-5221-4fff-aee0-d2283c8c9839]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4456f5-c275-43c6-af95-e280bcebef3e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]
Nov 27 23:04:53 user nova-compute[75621]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:53 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8214MB free_disk=25.440811157226562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance destroyed successfully.
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e89c03-03, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83aa1a76-35d9-4fac-8dce-c3af4d10088e) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df893fd8-cef6-48d3-875a-948e5fab12fc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 1.112s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== disconnect_volume: return (1855ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.043s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:53 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:53 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: INFO os_vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start _get_guest_xml network_info=[{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '422cfe61-6f56-4d2e-98d7-41f5ccd0703f', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b04a6cd0-3193-4b86-8563-1d889000e76e', 'attached_at': '', 'detached_at': '', 'volume_id': '50bfd854-7ced-465f-9682-753bb197abe2', 'serial': '50bfd854-7ced-465f-9682-753bb197abe2'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'numa_topology' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:53 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a40dae2-511a-4719-b20a-b456efbf8045]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:53 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e2a94-bd63-4699-8144-64793d0013e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37] added
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:53 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d4f548-4200-46c6-aa66-4e747861dc1f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'vcpu_model' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Applying migration context for instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 as it has an incoming, in-progress migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b. Migration status is migrating {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 23:04:53 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating resource usage from migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8281472-382f-4bd7-954e-775f7f4ebe04]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxViRKvU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:53 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rxViRKvU" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6b18e-f549-44af-8b7e-d536bbf4ccc6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 52b096b8-1aab-494d-a4eb-becbf8313dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1fe93184-5f27-493e-a456-3606f33f5c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rxViRKvU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6f5e9-cccf-4636-b7c6-52fdcd334887]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26db64-ba5c-4592-ad7b-4d9b89e74f85]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414aebc-25cd-4846-9f1a-03b8aa87e9e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260]
Nov 27 23:04:53 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e75ef5-1c12-4c47-aa36-515bb89d4512]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[260aecc4-a15b-4063-81cf-a19e2eb29805]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aed23d-8996-4885-979c-46dabae1f0f4]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxViRKvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:04:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.634s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== connect_volume: return (2489ms) {'type': 'block', 'scsi_wwn': '23838366234613233', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23838366234613233', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.423s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6be7e5-004a-4218-b14e-b14af3e8c6a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:04:54 user nova-compute[75621]: No targets found.
Nov 27 23:04:54 user nova-compute[75621]: iSNS:
Nov 27 23:04:54 user nova-compute[75621]: No targets found.
Nov 27 23:04:54 user nova-compute[75621]: STATIC:
Nov 27 23:04:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:04:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:04:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37
Nov 27 23:04:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681
Nov 27 23:04:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef
Nov 27 23:04:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:04:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:04:54 user nova-compute[75621]: FIRMWARE:
Nov 27 23:04:54 user nova-compute[75621]: No targets found.
Nov 27 23:04:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:04:54 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:04:54 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lazy-loading 'pci_devices' on Instance uuid 1fe93184-5f27-493e-a456-3606f33f5c23 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2850ad76-4d76-45ce-b40c-cf09a6a1e994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:04:54 user nova-compute[75621]:   <uuid>1fe93184-5f27-493e-a456-3606f33f5c23</uuid>
Nov 27 23:04:54 user nova-compute[75621]:   <name>instance-0000000e</name>
Nov 27 23:04:54 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:04:54 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:04:54 user nova-compute[75621]:   <metadata>
Nov 27 23:04:54 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:54 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:name>tempest-device-tagging-server-1477975072</nova:name>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:04:48</nova:creationTime>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:04:54 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:54 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:owner>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:user uuid="c012c6799710443c938fb052e6f06a01">tempest-TaggedBootDevicesTest-1263128950-project-member</nova:user>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:project uuid="86b7693a0b2b447e944fc201f80241a1">tempest-TaggedBootDevicesTest-1263128950</nova:project>
Nov 27 23:04:54 user nova-compute[75621]:       </nova:owner>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:54 user nova-compute[75621]:       <nova:ports>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="27cd43be-7423-4cda-ba31-f7a17e03f6ee">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.65" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="24e9c835-932d-457a-9d46-7dde72d964df">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.33" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="7ef8ac6f-fa30-47cf-acdb-7c2377b15192">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.120" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="069bee22-5acb-47ee-b58d-61642f7313ab">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="18d1ecf2-c45c-4910-9633-0c089367122d">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:         <nova:port uuid="0d7addf1-53ea-4f62-8d7e-5654c5e02578">
Nov 27 23:04:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 27 23:04:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:54 user nova-compute[75621]:       </nova:ports>
Nov 27 23:04:54 user nova-compute[75621]:     </nova:instance>
Nov 27 23:04:54 user nova-compute[75621]:   </metadata>
Nov 27 23:04:54 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:04:54 user nova-compute[75621]:     <system>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="serial">1fe93184-5f27-493e-a456-3606f33f5c23</entry>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="uuid">1fe93184-5f27-493e-a456-3606f33f5c23</entry>
Nov 27 23:04:54 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:04:54 user nova-compute[75621]:     </system>
Nov 27 23:04:54 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:54 user nova-compute[75621]:   <os>
Nov 27 23:04:54 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:04:54 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:04:54 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:04:54 user nova-compute[75621]:   </os>
Nov 27 23:04:54 user nova-compute[75621]:   <features>
Nov 27 23:04:54 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:54 user nova-compute[75621]:     <apic/>
Nov 27 23:04:54 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:04:54 user nova-compute[75621]:   </features>
Nov 27 23:04:54 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:04:54 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:04:54 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:04:54 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:04:54 user nova-compute[75621]:   </clock>
Nov 27 23:04:54 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:04:54 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:04:54 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:04:54 user nova-compute[75621]:   </cpu>
Nov 27 23:04:54 user nova-compute[75621]:   <devices>
Nov 27 23:04:54 user nova-compute[75621]:     <disk type="file" device="cdrom">
Nov 27 23:04:54 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none"/>
Nov 27 23:04:54 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/disk.config"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="hda" bus="ide"/>
Nov 27 23:04:54 user nova-compute[75621]:     </disk>
Nov 27 23:04:54 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:04:54 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:54 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <serial>9bb736b2-15c9-4074-a468-052dedf8fdef</serial>
Nov 27 23:04:54 user nova-compute[75621]:     </disk>
Nov 27 23:04:54 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:04:54 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:54 user nova-compute[75621]:       <source dev="/dev/sdf"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <serial>b0fd4c35-4264-42b3-a76a-0a506cac4681</serial>
Nov 27 23:04:54 user nova-compute[75621]:     </disk>
Nov 27 23:04:54 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:04:54 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:54 user nova-compute[75621]:       <source dev="/dev/sde"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="vdc" bus="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <serial>eee7749b-be40-4ef4-ac4c-afc46c3bdf37</serial>
Nov 27 23:04:54 user nova-compute[75621]:     </disk>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:34:af:96"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap27cd43be-74"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:89:1f:b7"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap7b8ca471-2a"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:8f:ad:22"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap24e9c835-93"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:0a:3c:13"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap7ef8ac6f-fa"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:ff:83:6c"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap069bee22-5a"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:b0:5c:de"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap18d1ecf2-c4"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:54 user nova-compute[75621]:       <mac address="fa:16:3e:e4:0a:dd"/>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:54 user nova-compute[75621]:       <target dev="tap0d7addf1-53"/>
Nov 27 23:04:54 user nova-compute[75621]:     </interface>
Nov 27 23:04:54 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:04:54 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/console.log" append="off"/>
Nov 27 23:04:54 user nova-compute[75621]:     </serial>
Nov 27 23:04:54 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:04:54 user nova-compute[75621]:     <video>
Nov 27 23:04:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:54 user nova-compute[75621]:     </video>
Nov 27 23:04:54 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:04:54 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:04:54 user nova-compute[75621]:     </rng>
Nov 27 23:04:54 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:04:54 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:04:54 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:04:54 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:54 user nova-compute[75621]:   </devices>
Nov 27 23:04:54 user nova-compute[75621]: </domain>
Nov 27 23:04:54 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39097fc3-52c2-5228-bcf6-36232995b353', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27cd43be-74, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27cd43be-74, col_values=(('qos', UUID('ee57c1c8-2819-40b8-a4f8-8772bd02dabd')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27cd43be-74, col_values=(('external_ids', {'iface-id': '27cd43be-7423-4cda-ba31-f7a17e03f6ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:af:96', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc79f817-09a9-4f5b-822e-face89e4187d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0759090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74')
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce0cb566-ff64-5e7c-a841-403006898bb1', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b8ca471-2a, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b8ca471-2a, col_values=(('qos', UUID('5f035ecc-31be-403f-ae7e-65133e4187ea')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b8ca471-2a, col_values=(('external_ids', {'iface-id': '7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:1f:b7', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c67079-b17b-4df9-b6a2-3ae0423d5aae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:54 user nova-compute[75621]: WARNING nova.compute.manager [req-671f8fff-8b2c-44ad-839e-44c8247af456 req-4d5f05a5-3e50-4daa-ac93-fe2477cd0633 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a')
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae9f29e5-8089-5e32-a294-4d276ad09328', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcf6239-6750-44ab-a598-4a06c5aad8e1]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b6238a-17cf-47dd-82db-a9ca8151fe33]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24e9c835-93, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24e9c835-93, col_values=(('qos', UUID('bad66eaa-b3ce-42e0-8b94-8bf83788e861')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24e9c835-93, col_values=(('external_ids', {'iface-id': '24e9c835-932d-457a-9d46-7dde72d964df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:ad:22', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93')
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12babd13-ec6c-4bcf-9f23-57135232cf3b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '447eebad-b43e-54d4-9540-08efb48cf592', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f85466b-8aa5-401a-8d86-f89038a6138c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ef8ac6f-fa, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ef8ac6f-fa, col_values=(('qos', UUID('fbb71760-6b04-404a-90ae-5adc5e552e3b')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ef8ac6f-fa, col_values=(('external_ids', {'iface-id': '7ef8ac6f-fa30-47cf-acdb-7c2377b15192', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:3c:13', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351ffc3-0abb-46c5-ae95-2d5cdec3e0f9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:04:55 user nova-compute[75621]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa')
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ef9c622-61fc-52ca-9214-29656a768956', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47a6f46-195a-42ed-bc9a-8b4ae7504c71]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.413s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== disconnect_volume: return (1837ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.714s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:04:55 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df60d57e-ac6d-48a8-a7b0-d578e060fe0a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:04:55 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap069bee22-5a, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap069bee22-5a, col_values=(('qos', UUID('6ff21c2d-09ca-487d-9f84-87e70f5bdc92')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap069bee22-5a, col_values=(('external_ids', {'iface-id': '069bee22-5acb-47ee-b58d-61642f7313ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:83:6c', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62af1ec8-86e6-4a51-a067-846352c3707e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2] added
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa7bb3-7022-449a-9e92-e48bd692d8c7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a')
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7f9d62-2687-4ef8-96ff-6a998f7250e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f8cb5e0-3d50-5446-a636-eb6281831616', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtoUZwnR {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MtoUZwnR" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[918d1354-7383-4d43-a173-fb33ef37b3bc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MtoUZwnR'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[763878a2-fc6d-413d-8919-d0a9e40849f9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18d1ecf2-c4, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap18d1ecf2-c4, col_values=(('qos', UUID('605b9463-8e8c-494e-a4c1-4aca25bc0f99')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap18d1ecf2-c4, col_values=(('external_ids', {'iface-id': '18d1ecf2-c45c-4910-9633-0c089367122d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5c:de', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33d522b-0b60-4f31-96ee-aa66e1c5d0e7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4')
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe1303-f3ae-4946-bde1-632543fe6483]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]
Nov 27 23:04:55 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8fc3d15-c61f-5988-9d8e-76418523573d', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55d6aec-070d-48bd-8e5a-a300f570264f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e92510-d67c-4c1e-8bb4-df6a4e96a274]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:04:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d7addf1-53, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d7addf1-53, col_values=(('qos', UUID('38bb1c43-c2b1-4125-815f-da4d867c7aaf')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d7addf1-53, col_values=(('external_ids', {'iface-id': '0d7addf1-53ea-4f62-8d7e-5654c5e02578', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:0a:dd', 'vm-uuid': '1fe93184-5f27-493e-a456-3606f33f5c23'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de74d65f-db13-483c-a4e5-ed13ec4d732c]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:55 user nova-compute[75621]: INFO os_vif [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53')
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_resize/disk /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] No BDM found with device name hda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] No VIF found with MAC fa:16:3e:34:af:96, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] No VIF found with MAC fa:16:3e:ff:83:6c, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:04:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Using config drive
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "cp -r /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_resize/disk /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk" returned: 0 in 0.417s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_resize/disk.info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk.info {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "cp -r /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_resize/disk.info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk.info" returned: 0 in 0.039s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Creating config drive at /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/disk.config
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqpu4q6ce {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqpu4q6ce" returned: 0 in 0.078s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== connect_volume: return (3107ms) {'type': 'block', 'scsi_wwn': '23061376536613730', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061376536613730', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'pci_devices' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:04:56 user nova-compute[75621]:   <uuid>b04a6cd0-3193-4b86-8563-1d889000e76e</uuid>
Nov 27 23:04:56 user nova-compute[75621]:   <name>instance-00000004</name>
Nov 27 23:04:56 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:04:56 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:04:56 user nova-compute[75621]:   <metadata>
Nov 27 23:04:56 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:04:56 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeTestJSON-server-1291519920</nova:name>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:04:53</nova:creationTime>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:04:56 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:04:56 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:owner>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:user uuid="cc5cf604fbfd4f1dbdbe80b05f540425">tempest-AttachVolumeTestJSON-1955560544-project-member</nova:user>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:project uuid="ea584e6a3e6b441d8fdec3f91a1c23ed">tempest-AttachVolumeTestJSON-1955560544</nova:project>
Nov 27 23:04:56 user nova-compute[75621]:       </nova:owner>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:04:56 user nova-compute[75621]:       <nova:ports>
Nov 27 23:04:56 user nova-compute[75621]:         <nova:port uuid="1b9f496e-4328-4bc8-9744-d6e3d2c3df4f">
Nov 27 23:04:56 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:04:56 user nova-compute[75621]:         </nova:port>
Nov 27 23:04:56 user nova-compute[75621]:       </nova:ports>
Nov 27 23:04:56 user nova-compute[75621]:     </nova:instance>
Nov 27 23:04:56 user nova-compute[75621]:   </metadata>
Nov 27 23:04:56 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:04:56 user nova-compute[75621]:     <system>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="serial">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="uuid">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:04:56 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:04:56 user nova-compute[75621]:     </system>
Nov 27 23:04:56 user nova-compute[75621]:   </sysinfo>
Nov 27 23:04:56 user nova-compute[75621]:   <os>
Nov 27 23:04:56 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:04:56 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:04:56 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:04:56 user nova-compute[75621]:   </os>
Nov 27 23:04:56 user nova-compute[75621]:   <features>
Nov 27 23:04:56 user nova-compute[75621]:     <acpi/>
Nov 27 23:04:56 user nova-compute[75621]:     <apic/>
Nov 27 23:04:56 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:04:56 user nova-compute[75621]:   </features>
Nov 27 23:04:56 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:04:56 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:04:56 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:04:56 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:04:56 user nova-compute[75621]:   </clock>
Nov 27 23:04:56 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:04:56 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:04:56 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:04:56 user nova-compute[75621]:   </cpu>
Nov 27 23:04:56 user nova-compute[75621]:   <devices>
Nov 27 23:04:56 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:04:56 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:04:56 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk"/>
Nov 27 23:04:56 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:04:56 user nova-compute[75621]:     </disk>
Nov 27 23:04:56 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:04:56 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:04:56 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:04:56 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:04:56 user nova-compute[75621]:       <serial>50bfd854-7ced-465f-9682-753bb197abe2</serial>
Nov 27 23:04:56 user nova-compute[75621]:     </disk>
Nov 27 23:04:56 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:04:56 user nova-compute[75621]:       <mac address="fa:16:3e:0e:a3:79"/>
Nov 27 23:04:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:56 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:04:56 user nova-compute[75621]:       <target dev="tap1b9f496e-43"/>
Nov 27 23:04:56 user nova-compute[75621]:     </interface>
Nov 27 23:04:56 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:04:56 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/console.log" append="off"/>
Nov 27 23:04:56 user nova-compute[75621]:     </serial>
Nov 27 23:04:56 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:04:56 user nova-compute[75621]:     <video>
Nov 27 23:04:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:04:56 user nova-compute[75621]:     </video>
Nov 27 23:04:56 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:04:56 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:04:56 user nova-compute[75621]:     </rng>
Nov 27 23:04:56 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:04:56 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:04:56 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:04:56 user nova-compute[75621]:     </memballoon>
Nov 27 23:04:56 user nova-compute[75621]:   </devices>
Nov 27 23:04:56 user nova-compute[75621]: </domain>
Nov 27 23:04:56 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:56 user nova-compute[75621]: WARNING nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:56 user nova-compute[75621]: WARNING nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:56 user nova-compute[75621]: WARNING nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:56 user nova-compute[75621]: WARNING nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:56 user nova-compute[75621]: WARNING nova.compute.manager [req-2335c391-705e-4647-943c-36cfb61d88de req-7ad3c8ce-83bb-4ddf-a59a-36e093e87b10 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_migrating.
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'trusted_certs' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:04:57 user nova-compute[75621]: INFO nova.compute.claims [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Claim successful on node user
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.235s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Port 37e89c03-0357-46ad-9765-d16725a8dca6 binding to destination host user is already ACTIVE {{(pid=75621) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Cannot resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'migration_context' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.objects.base [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG os_vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27256700-d9e3-5738-9fb4-eee93f739db8', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b9f496e-43, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b9f496e-43, col_values=(('qos', UUID('30716e07-6403-4435-88dd-67cacb6da456')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b9f496e-43, col_values=(('external_ids', {'iface-id': '1b9f496e-4328-4bc8-9744-d6e3d2c3df4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a3:79', 'vm-uuid': 'b04a6cd0-3193-4b86-8563-1d889000e76e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: INFO os_vif [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:04:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.691s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:04:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:04:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:04:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:04:58 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Creating image(s)
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "/opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "/opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.policy [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98804fc0734a4911a2ec7cf891793b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344bc4bacbb477fa732dd9c2b4d191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.utils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8741914-034c-4206-b8c5-feb3c7c72a3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249ccba-0f6b-45c5-bee2-67697417ac1c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[967c9a97-18f9-4a1b-a349-291cfb502603]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da69397-0063-43a7-a0fa-b6cd08acf17b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.224s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:04:58 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9f355a-38d9-4bd5-915b-32efd51a88fa]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG os_brick.utils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk 1073741824" returned: 0 in 0.055s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.210s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Cannot resize image /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Ensure instance console log exists: /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:58 user nova-compute[75621]: WARNING nova.compute.manager [req-45f7e599-323a-4cb9-9819-97ac7fb665f0 req-35162b3c-d412-4073-a4a0-32494d71fc5e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c for instance with vm_state building and task_state spawning.
Nov 27 23:04:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Successfully created port: 3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:04:59 user nova-compute[75621]: WARNING nova.compute.manager [req-ae429d45-c2f7-4c9b-bc59-2c2c3c2bcae7 req-c2736473-6685-4fee-9c21-25d51370c777 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee for instance with vm_state building and task_state spawning.
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:04:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Successfully updated port: 3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquired lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:00 user nova-compute[75621]: WARNING nova.compute.manager [req-8a361b54-c3e0-4756-b964-fadd6c7a72da req-413835fa-cf55-4e92-bbb1-96931a2da18d service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state powering-on.
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updating instance_info_cache with network_info: [{"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Releasing lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Instance network_info: |[{"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Start _get_guest_xml network_info=[{"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292644308',display_name='tempest-ServersNegativeTestJSON-server-1292644308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292644308',id=16,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-jxsoem81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:58Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=d0ad520b-a961-42cd-bb7e-67329a158e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lazy-loading 'pci_devices' on Instance uuid d0ad520b-a961-42cd-bb7e-67329a158e5d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-bcf53261-7539-49bc-9a10-f25a1fde34ca req-70740de4-fcea-4999-bfb8-cf90a344f0ce service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:05:01 user nova-compute[75621]:   <uuid>d0ad520b-a961-42cd-bb7e-67329a158e5d</uuid>
Nov 27 23:05:01 user nova-compute[75621]:   <name>instance-00000010</name>
Nov 27 23:05:01 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:05:01 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:05:01 user nova-compute[75621]:   <metadata>
Nov 27 23:05:01 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:05:01 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:name>tempest-ServersNegativeTestJSON-server-1292644308</nova:name>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:05:01</nova:creationTime>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:05:01 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:05:01 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:owner>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:user uuid="98804fc0734a4911a2ec7cf891793b16">tempest-ServersNegativeTestJSON-628018506-project-member</nova:user>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:project uuid="1344bc4bacbb477fa732dd9c2b4d191a">tempest-ServersNegativeTestJSON-628018506</nova:project>
Nov 27 23:05:01 user nova-compute[75621]:       </nova:owner>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:05:01 user nova-compute[75621]:       <nova:ports>
Nov 27 23:05:01 user nova-compute[75621]:         <nova:port uuid="3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6">
Nov 27 23:05:01 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:05:01 user nova-compute[75621]:         </nova:port>
Nov 27 23:05:01 user nova-compute[75621]:       </nova:ports>
Nov 27 23:05:01 user nova-compute[75621]:     </nova:instance>
Nov 27 23:05:01 user nova-compute[75621]:   </metadata>
Nov 27 23:05:01 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:05:01 user nova-compute[75621]:     <system>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="serial">d0ad520b-a961-42cd-bb7e-67329a158e5d</entry>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="uuid">d0ad520b-a961-42cd-bb7e-67329a158e5d</entry>
Nov 27 23:05:01 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:05:01 user nova-compute[75621]:     </system>
Nov 27 23:05:01 user nova-compute[75621]:   </sysinfo>
Nov 27 23:05:01 user nova-compute[75621]:   <os>
Nov 27 23:05:01 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:05:01 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:05:01 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:05:01 user nova-compute[75621]:   </os>
Nov 27 23:05:01 user nova-compute[75621]:   <features>
Nov 27 23:05:01 user nova-compute[75621]:     <acpi/>
Nov 27 23:05:01 user nova-compute[75621]:     <apic/>
Nov 27 23:05:01 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:05:01 user nova-compute[75621]:   </features>
Nov 27 23:05:01 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:05:01 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:05:01 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:05:01 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:05:01 user nova-compute[75621]:   </clock>
Nov 27 23:05:01 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:05:01 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:05:01 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:05:01 user nova-compute[75621]:   </cpu>
Nov 27 23:05:01 user nova-compute[75621]:   <devices>
Nov 27 23:05:01 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:05:01 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:05:01 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk"/>
Nov 27 23:05:01 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:05:01 user nova-compute[75621]:     </disk>
Nov 27 23:05:01 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:05:01 user nova-compute[75621]:       <mac address="fa:16:3e:28:d9:1d"/>
Nov 27 23:05:01 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:01 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:05:01 user nova-compute[75621]:       <target dev="tap3e7f41f4-d0"/>
Nov 27 23:05:01 user nova-compute[75621]:     </interface>
Nov 27 23:05:01 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:05:01 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/console.log" append="off"/>
Nov 27 23:05:01 user nova-compute[75621]:     </serial>
Nov 27 23:05:01 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:05:01 user nova-compute[75621]:     <video>
Nov 27 23:05:01 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:01 user nova-compute[75621]:     </video>
Nov 27 23:05:01 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:05:01 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:05:01 user nova-compute[75621]:     </rng>
Nov 27 23:05:01 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:05:01 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:05:01 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:05:01 user nova-compute[75621]:     </memballoon>
Nov 27 23:05:01 user nova-compute[75621]:   </devices>
Nov 27 23:05:01 user nova-compute[75621]: </domain>
Nov 27 23:05:01 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292644308',display_name='tempest-ServersNegativeTestJSON-server-1292644308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292644308',id=16,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-jxsoem81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:58Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=d0ad520b-a961-42cd-bb7e-67329a158e5d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG os_vif [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '997cd32a-3d4f-5f62-93e9-ec5d53401bdd', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e7f41f4-d0, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e7f41f4-d0, col_values=(('qos', UUID('3a99363a-03c2-4108-acf7-a750796762dd')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e7f41f4-d0, col_values=(('external_ids', {'iface-id': '3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:d9:1d', 'vm-uuid': 'd0ad520b-a961-42cd-bb7e-67329a158e5d'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: INFO os_vif [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0')
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] No VIF found with MAC fa:16:3e:28:d9:1d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:01 user nova-compute[75621]: WARNING nova.compute.manager [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee for instance with vm_state building and task_state spawning.
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-changed-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Refreshing instance network info cache due to event network-changed-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Acquiring lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Acquired lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:01 user nova-compute[75621]: DEBUG nova.network.neutron [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Refreshing network info cache for port 3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updated VIF entry in instance network info cache for port 3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.network.neutron [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updating instance_info_cache with network_info: [{"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e513edd6-42b4-433e-b5b4-7504d5e2783e req-379f8354-8301-48af-85b9-1a450280a7bd service nova] Releasing lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:02 user nova-compute[75621]: WARNING nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state powering-on.
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:02 user nova-compute[75621]: WARNING nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 for instance with vm_state building and task_state spawning.
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:02 user nova-compute[75621]: WARNING nova.compute.manager [req-be31f932-6893-409b-978e-f20642bb2239 req-6b89608f-d85d-4b2c-aca4-c80180d87935 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:03 user nova-compute[75621]: WARNING nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:03 user nova-compute[75621]: WARNING nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:03 user nova-compute[75621]: WARNING nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:03 user nova-compute[75621]: WARNING nova.compute.manager [req-07eb36d6-430c-4383-9e60-5acbdc7c3afa req-2b47287c-95de-480e-bca4-c7dbf764b108 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] No waiting events found dispatching network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:03 user nova-compute[75621]: WARNING nova.compute.manager [req-c6591ac7-44ef-46e9-bb6c-1cd39419d8b2 req-7269d7ad-3e1f-4143-84ec-7ead49bd5c3e service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received unexpected event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 for instance with vm_state building and task_state spawning.
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:05:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance rebooted successfully.
Nov 27 23:05:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a446a47a-b64d-44c0-b368-d2bf96df149f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Instance spawned successfully.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance spawned successfully.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Took 7.58 seconds to spawn the instance on the hypervisor.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Took 17.02 seconds to spawn the instance on the hypervisor.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] No waiting events found dispatching network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:05 user nova-compute[75621]: WARNING nova.compute.manager [req-68436708-817c-469e-820c-291efdde1b58 req-713fe381-b648-4a07-ae30-194391c1da9a service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received unexpected event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 for instance with vm_state building and task_state spawning.
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.compute.manager [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Took 8.79 seconds to build instance.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2cd39f32-2084-4822-9356-b21bf93edf5c tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.917s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:05 user nova-compute[75621]: INFO nova.compute.manager [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Took 42.34 seconds to build instance.
Nov 27 23:05:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66132f75-3c00-4c18-b4b9-f055c1a35f85 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.452s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Starting finish_migration {{(pid=75621) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:05:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Creating image(s)
Nov 27 23:05:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk. size=21474836480 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk 21474836480 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk 21474836480" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Ensure instance console log exists: /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start _get_guest_xml network_info=[{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '91aab4f6-ac4a-4b4e-a073-d8ae9f0884b8', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'db2447ed-f456-41e5-b4bd-2dc243ad6c33', 'attached_at': '2023-11-27T23:05:07.000000', 'detached_at': '', 'volume_id': '4203dc00-ff03-4099-ad7d-021d6c07a20a', 'serial': '4203dc00-ff03-4099-ad7d-021d6c07a20a'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:05:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:05:08 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:05:08 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:05:08 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242ee46-706b-4d38-ab74-6eb174b3d8a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:05:08 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[946d22a1-ead6-4d26-9ecf-35bd09e1aca9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e03d702-6008-4431-9443-fdc380c2c64f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b412452-3bb8-4b80-8120-35b1717a5c6a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ce1cc-314f-4604-bd1b-20c2e620f2ef]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcTuhSKy'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a161ae27-5f10-4c12-87c6-fcfe9f665043]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaef713-c1bb-4ef8-8a35-49eccae17022]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e927b56f-bc8d-454f-93f4-0caf3eff06b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:05:08 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51668c53-4ae5-4cb4-b984-407caf43d0cf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a1a8e3-e95c-4d29-b7ad-215579b6b09e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:08 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:05:08 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] HCTL ('38', '-', '-', 0) found on session 17 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a643ee-d73a-43c0-8957-35803b264b2c]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching for a device in session 17 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:05:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== connect_volume: return (1388ms) {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdg'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdg'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:05:09 user nova-compute[75621]:   <uuid>db2447ed-f456-41e5-b4bd-2dc243ad6c33</uuid>
Nov 27 23:05:09 user nova-compute[75621]:   <name>instance-00000002</name>
Nov 27 23:05:09 user nova-compute[75621]:   <memory>2097152</memory>
Nov 27 23:05:09 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:05:09 user nova-compute[75621]:   <metadata>
Nov 27 23:05:09 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:05:09 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherB-server-774787445</nova:name>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:05:08</nova:creationTime>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:flavor name="m1.small">
Nov 27 23:05:09 user nova-compute[75621]:         <nova:memory>2048</nova:memory>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:disk>20</nova:disk>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:05:09 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:owner>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:user uuid="f116260296b94e55916e029d103f2126">tempest-ServerActionsTestOtherB-236791637-project-member</nova:user>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:project uuid="776ddd88f0e543769f6e275217231ecd">tempest-ServerActionsTestOtherB-236791637</nova:project>
Nov 27 23:05:09 user nova-compute[75621]:       </nova:owner>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:05:09 user nova-compute[75621]:       <nova:ports>
Nov 27 23:05:09 user nova-compute[75621]:         <nova:port uuid="37e89c03-0357-46ad-9765-d16725a8dca6">
Nov 27 23:05:09 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:05:09 user nova-compute[75621]:         </nova:port>
Nov 27 23:05:09 user nova-compute[75621]:       </nova:ports>
Nov 27 23:05:09 user nova-compute[75621]:     </nova:instance>
Nov 27 23:05:09 user nova-compute[75621]:   </metadata>
Nov 27 23:05:09 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:05:09 user nova-compute[75621]:     <system>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="serial">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="uuid">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:05:09 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:05:09 user nova-compute[75621]:     </system>
Nov 27 23:05:09 user nova-compute[75621]:   </sysinfo>
Nov 27 23:05:09 user nova-compute[75621]:   <os>
Nov 27 23:05:09 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:05:09 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:05:09 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:05:09 user nova-compute[75621]:   </os>
Nov 27 23:05:09 user nova-compute[75621]:   <features>
Nov 27 23:05:09 user nova-compute[75621]:     <acpi/>
Nov 27 23:05:09 user nova-compute[75621]:     <apic/>
Nov 27 23:05:09 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:05:09 user nova-compute[75621]:   </features>
Nov 27 23:05:09 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:05:09 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:05:09 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:05:09 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:05:09 user nova-compute[75621]:   </clock>
Nov 27 23:05:09 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:05:09 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:05:09 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:05:09 user nova-compute[75621]:   </cpu>
Nov 27 23:05:09 user nova-compute[75621]:   <devices>
Nov 27 23:05:09 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:05:09 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:05:09 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk"/>
Nov 27 23:05:09 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:05:09 user nova-compute[75621]:     </disk>
Nov 27 23:05:09 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:05:09 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:05:09 user nova-compute[75621]:       <source dev="/dev/sdg"/>
Nov 27 23:05:09 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:05:09 user nova-compute[75621]:       <serial>4203dc00-ff03-4099-ad7d-021d6c07a20a</serial>
Nov 27 23:05:09 user nova-compute[75621]:     </disk>
Nov 27 23:05:09 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:05:09 user nova-compute[75621]:       <mac address="fa:16:3e:c7:38:3e"/>
Nov 27 23:05:09 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:09 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:05:09 user nova-compute[75621]:       <target dev="tap37e89c03-03"/>
Nov 27 23:05:09 user nova-compute[75621]:     </interface>
Nov 27 23:05:09 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:05:09 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/console.log" append="off"/>
Nov 27 23:05:09 user nova-compute[75621]:     </serial>
Nov 27 23:05:09 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:05:09 user nova-compute[75621]:     <video>
Nov 27 23:05:09 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:09 user nova-compute[75621]:     </video>
Nov 27 23:05:09 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:05:09 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:05:09 user nova-compute[75621]:     </rng>
Nov 27 23:05:09 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:05:09 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:05:09 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:05:09 user nova-compute[75621]:     </memballoon>
Nov 27 23:05:09 user nova-compute[75621]:   </devices>
Nov 27 23:05:09 user nova-compute[75621]: </domain>
Nov 27 23:05:09 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2099597084-network", "vif_mac": "fa:16:3e:c7:38:3e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG os_vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c9edd9e-acf0-5757-a6e0-90235a8d6978', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e89c03-03, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37e89c03-03, col_values=(('qos', UUID('1908bddd-5232-4348-a5bd-2d9f37a0d800')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37e89c03-03, col_values=(('external_ids', {'iface-id': '37e89c03-0357-46ad-9765-d16725a8dca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:38:3e', 'vm-uuid': 'db2447ed-f456-41e5-b4bd-2dc243ad6c33'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:09 user nova-compute[75621]: INFO os_vif [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] No VIF found with MAC fa:16:3e:c7:38:3e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:11 user nova-compute[75621]: WARNING nova.compute.manager [req-f0926a45-7752-4b7d-9f89-8e4e25af6868 req-060722d6-6d35-49a5-93aa-e1e87c54b7b8 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_finish.
Nov 27 23:05:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:13 user nova-compute[75621]: WARNING nova.compute.manager [req-4c3d837c-e229-4046-8255-96650e4a3b7f req-3ef4b9ac-6b83-41d5-b25f-777c17673ee4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state resize_finish.
Nov 27 23:05:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:05:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance running successfully.
Nov 27 23:05:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Failed to set time: agent not configured {{(pid=75621) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 23:05:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f2151c2-e692-48f2-8d75-debd44b64bda tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] finish_migration finished successfully. {{(pid=75621) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 23:05:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:46 user nova-compute[75621]: INFO nova.compute.manager [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Rescuing
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG nova.network.neutron [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:47 user nova-compute[75621]: WARNING nova.compute.manager [req-b4f6c45e-14b0-4374-be73-7442e8e8ea18 req-b4e9b0b9-c6d3-40b8-ab3d-f063e1242573 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state active and task_state rescuing.
Nov 27 23:05:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance destroyed successfully.
Nov 27 23:05:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Attempting a stable device rescue
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:05:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Creating image(s)
Nov 27 23:05:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'trusted_certs' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "21a813150daafe8e4749aa78171ea4e686187dca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "21a813150daafe8e4749aa78171ea4e686187dca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG nova.virt.images [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] 398092f4-7489-471b-97f1-42a9366a635b was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.part /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:49 user nova-compute[75621]: WARNING nova.compute.manager [req-0e9e0534-9850-4623-993d-54cf3429dc6f req-2fb5f45f-515e-414a-a6d3-589b0429f2ea service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state active and task_state rescuing.
Nov 27 23:05:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.part /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.converted" returned: 0 in 0.655s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "21a813150daafe8e4749aa78171ea4e686187dca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.342s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "21a813150daafe8e4749aa78171ea4e686187dca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "21a813150daafe8e4749aa78171ea4e686187dca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca --force-share --output=json" returned: 0 in 0.216s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca,backing_fmt=raw /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca,backing_fmt=raw /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue" returned: 0 in 0.127s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "21a813150daafe8e4749aa78171ea4e686187dca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.347s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'migration_context' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<b75ec495-38b4-42ff-a489-13b76129b094> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start _get_guest_xml network_info=[{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:7c:0f:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '398092f4-7489-471b-97f1-42a9366a635b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '32e0081c-4a82-42d9-98d7-6a586a1a89ee', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b75ec495-38b4-42ff-a489-13b76129b094', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'serial': 'b4e8520c-4c32-4d15-9ae3-7fc63e2aae25'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<b75ec495-38b4-42ff-a489-13b76129b094> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'numa_topology' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<b75ec495-38b4-42ff-a489-13b76129b094> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:05:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'vcpu_model' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.objects.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<b75ec495-38b4-42ff-a489-13b76129b094> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:05:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:05:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:05:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:05:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:05:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:05:50 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:05:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9373f-f34e-4f52-9bb9-080369981fad]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pgxoOQDU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 23:05:51 user nova-compute[75621]: node.name = iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:05:51 user nova-compute[75621]: node.tpgt = -1
Nov 27 23:05:51 user nova-compute[75621]: node.startup = automatic
Nov 27 23:05:51 user nova-compute[75621]: node.leading_login = No
Nov 27 23:05:51 user nova-compute[75621]: iface.iscsi_ifacename = default
Nov 27 23:05:51 user nova-compute[75621]: iface.net_ifacename = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.ipaddress = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.prefix_len = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.hwaddress = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.transport_name = tcp
Nov 27 23:05:51 user nova-compute[75621]: iface.initiatorname = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.vlan_id = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.vlan_priority = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.vlan_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.iface_num = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.mtu = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.port = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.bootproto = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.subnet_mask = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.gateway = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_alt_client_id = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_dns = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_learn_iqn = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_vendor_id_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_vendor_id = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.dhcp_slp_da = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.fragmentation = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.gratuitous_arp = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.incoming_forwarding = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.tos_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.tos = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.ttl = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.delayed_ack = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.tcp_nagle = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.tcp_wsf_state = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.tcp_wsf = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.tcp_timer_scale = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.tcp_timestamp = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.redirect = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.def_task_mgmt_timeout = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.header_digest = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.data_digest = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.immediate_data = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.initial_r2t = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.data_seq_inorder = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.data_pdu_inorder = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.erl = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.max_receive_data_len = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.first_burst_len = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.max_outstanding_r2t = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.max_burst_len = 0
Nov 27 23:05:51 user nova-compute[75621]: iface.chap_auth = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.bidi_chap = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.strict_login_compliance = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.discovery_auth = <empty>
Nov 27 23:05:51 user nova-compute[75621]: iface.discovery_logout = <empty>
Nov 27 23:05:51 user nova-compute[75621]: node.discovery_address = <empty>
Nov 27 23:05:51 user nova-compute[75621]: node.discovery_port = 0
Nov 27 23:05:51 user nova-compute[75621]: node.discovery_type = static
Nov 27 23:05:51 user nova-compute[75621]: node.session.initial_cmdsn = 0
Nov 27 23:05:51 user nova-compute[75621]: node.session.initial_login_retry_max = 8
Nov 27 23:05:51 user nova-compute[75621]: node.session.xmit_thread_priority = -20
Nov 27 23:05:51 user nova-compute[75621]: node.session.cmds_max = 128
Nov 27 23:05:51 user nova-compute[75621]: node.session.queue_depth = 32
Nov 27 23:05:51 user nova-compute[75621]: node.session.nr_sessions = 1
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.authmethod = CHAP
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.username = pgxoOQDU
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.password = ***
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.username_in = <empty>
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.password_in = <empty>
Nov 27 23:05:51 user nova-compute[75621]: node.session.auth.chap_algs = MD5
Nov 27 23:05:51 user nova-compute[75621]: node.session.timeo.replacement_timeout = 120
Nov 27 23:05:51 user nova-compute[75621]: node.session.err_timeo.abort_timeout = 15
Nov 27 23:05:51 user nova-compute[75621]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 23:05:51 user nova-compute[75621]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 23:05:51 user nova-compute[75621]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.FastAbort = Yes
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.InitialR2T = No
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.ImmediateData = Yes
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.MaxConnections = 1
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 23:05:51 user nova-compute[75621]: node.session.iscsi.ERL = 0
Nov 27 23:05:51 user nova-compute[75621]: node.session.scan = manual
Nov 27 23:05:51 user nova-compute[75621]: node.session.reopen_max = 0
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].address = 172.16.0.220
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].port = 3260
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].startup = manual
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].tcp.window_size = 524288
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].tcp.type_of_service = 0
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].timeo.logout_timeout = 15
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].timeo.login_timeout = 15
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].timeo.auth_timeout = 45
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.DataDigest = None
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.IFMarker = No
Nov 27 23:05:51 user nova-compute[75621]: node.conn[0].iscsi.OFMarker = No
Nov 27 23:05:51 user nova-compute[75621]: # END RECORD
Nov 27 23:05:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b63623-494e-4292-abbf-15206396a033]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79712d4b-0fae-4b8b-927a-4bbaa6215962]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgxoOQDU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgxoOQDU" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53bdb1b-dc41-4578-be52-3c428755508d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgxoOQDU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c41265-58b4-4e3a-898b-396cc6f997b1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[93031610-f7ea-4233-8817-bfcde61c1bfa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:05:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:05:51 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:05:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.195s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] HCTL ('33', '0', '0', 0) found on session 11 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6caad61-1d09-46a9-887c-4064f83f8592]: (4, ('0 0 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching for a device in session 11 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== connect_volume: return (227ms) {'type': 'block', 'scsi_wwn': '26233346231636234', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233346231636234', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4921025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4921025',id=12,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:04:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-4qj2t6f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:04:12Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=b75ec495-38b4-42ff-a489-13b76129b094,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:7c:0f:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:7c:0f:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.objects.base [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<b75ec495-38b4-42ff-a489-13b76129b094> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:05:51 user nova-compute[75621]:   <uuid>b75ec495-38b4-42ff-a489-13b76129b094</uuid>
Nov 27 23:05:51 user nova-compute[75621]:   <name>instance-0000000c</name>
Nov 27 23:05:51 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:05:51 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:05:51 user nova-compute[75621]:   <metadata>
Nov 27 23:05:51 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:05:51 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-4921025</nova:name>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:05:50</nova:creationTime>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:05:51 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:05:51 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:owner>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:05:51 user nova-compute[75621]:       </nova:owner>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:05:51 user nova-compute[75621]:       <nova:ports>
Nov 27 23:05:51 user nova-compute[75621]:         <nova:port uuid="ac7d5fc9-24e0-4544-a84e-187023fd6e8a">
Nov 27 23:05:51 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 27 23:05:51 user nova-compute[75621]:         </nova:port>
Nov 27 23:05:51 user nova-compute[75621]:       </nova:ports>
Nov 27 23:05:51 user nova-compute[75621]:     </nova:instance>
Nov 27 23:05:51 user nova-compute[75621]:   </metadata>
Nov 27 23:05:51 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:05:51 user nova-compute[75621]:     <system>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="serial">b75ec495-38b4-42ff-a489-13b76129b094</entry>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="uuid">b75ec495-38b4-42ff-a489-13b76129b094</entry>
Nov 27 23:05:51 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:05:51 user nova-compute[75621]:     </system>
Nov 27 23:05:51 user nova-compute[75621]:   </sysinfo>
Nov 27 23:05:51 user nova-compute[75621]:   <os>
Nov 27 23:05:51 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:05:51 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:05:51 user nova-compute[75621]:   </os>
Nov 27 23:05:51 user nova-compute[75621]:   <features>
Nov 27 23:05:51 user nova-compute[75621]:     <acpi/>
Nov 27 23:05:51 user nova-compute[75621]:     <apic/>
Nov 27 23:05:51 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:05:51 user nova-compute[75621]:   </features>
Nov 27 23:05:51 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:05:51 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:05:51 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:05:51 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:05:51 user nova-compute[75621]:   </clock>
Nov 27 23:05:51 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:05:51 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:05:51 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:05:51 user nova-compute[75621]:   </cpu>
Nov 27 23:05:51 user nova-compute[75621]:   <devices>
Nov 27 23:05:51 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:05:51 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:05:51 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:05:51 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:05:51 user nova-compute[75621]:       <serial>b4e8520c-4c32-4d15-9ae3-7fc63e2aae25</serial>
Nov 27 23:05:51 user nova-compute[75621]:     </disk>
Nov 27 23:05:51 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:05:51 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:05:51 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue"/>
Nov 27 23:05:51 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:05:51 user nova-compute[75621]:       <boot order="1"/>
Nov 27 23:05:51 user nova-compute[75621]:     </disk>
Nov 27 23:05:51 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:05:51 user nova-compute[75621]:       <mac address="fa:16:3e:7c:0f:22"/>
Nov 27 23:05:51 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:51 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:05:51 user nova-compute[75621]:       <target dev="tapac7d5fc9-24"/>
Nov 27 23:05:51 user nova-compute[75621]:     </interface>
Nov 27 23:05:51 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:05:51 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/console.log" append="off"/>
Nov 27 23:05:51 user nova-compute[75621]:     </serial>
Nov 27 23:05:51 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:05:51 user nova-compute[75621]:     <video>
Nov 27 23:05:51 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:51 user nova-compute[75621]:     </video>
Nov 27 23:05:51 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:05:51 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:05:51 user nova-compute[75621]:     </rng>
Nov 27 23:05:51 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:05:51 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:05:51 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:05:51 user nova-compute[75621]:     </memballoon>
Nov 27 23:05:51 user nova-compute[75621]:   </devices>
Nov 27 23:05:51 user nova-compute[75621]: </domain>
Nov 27 23:05:51 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:05:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance destroyed successfully.
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:7c:0f:22, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:53 user nova-compute[75621]: WARNING nova.compute.manager [req-3a31e4a6-1295-4a2a-bab3-29ab9c4873c7 req-bb0ae74d-8545-4f0f-97c7-3be772130c72 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state active and task_state rescuing.
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:05:54 user nova-compute[75621]: INFO nova.compute.claims [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Claim successful on node user
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:05:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:05:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Creating image(s)
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "/opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "/opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.014s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json" returned: 0 in 0.226s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-6787d94f-661d-4df1-a7e6-49e86f51bbe2 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:05:55 user nova-compute[75621]: DEBUG nova.policy [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c8bcb7c9d0e4134b98ab1124efa2b78', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca878afb27024c96805509fa25a68ad6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:05:56 user nova-compute[75621]: WARNING nova.compute.manager [req-b074fff9-985b-4e26-84f3-dc88dfef0250 req-e6eec8c7-c9d1-4147-b6aa-6b8eccc6dcf5 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state active and task_state rescuing.
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.754s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7413MB free_disk=25.242557525634766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Applying migration context for instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 as it has an incoming, in-progress migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b. Migration status is finished {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 23:05:56 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating resource usage from migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk 1073741824" returned: 0 in 0.068s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 52b096b8-1aab-494d-a4eb-becbf8313dd3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1fe93184-5f27-493e-a456-3606f33f5c23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance a8105968-7ab2-4423-8596-36996d55397f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.300s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Successfully created port: 7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Cannot resize image /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Ensure instance console log exists: /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:05:56 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.989s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Successfully updated port: 7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquired lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-changed-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Refreshing instance network info cache due to event network-changed-7ac5733a-2058-40e6-9da9-33e12a0c9ac8. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] Acquiring lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:05:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updating instance_info_cache with network_info: [{"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Releasing lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Instance network_info: |[{"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] Acquired lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Refreshing network info cache for port 7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Start _get_guest_xml network_info=[{"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:05:58 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:58 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2132521757',display_name='tempest-TestVolumeSwap-server-2132521757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2132521757',id=17,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuni9XGmpKMfrSj/y0BwkcQJFrVBUk3TdYvqKEErkuNC/8/yy9GXdTwvDCVQf4iyx6NFBsijrWfZC39TGE4tAz06R3K1jwCMLws2r2v/b3n5nTOw0AMkUN2nfmFvvpVUA==',key_name='tempest-keypair-1854963224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca878afb27024c96805509fa25a68ad6',ramdisk_id='',reservation_id='r-04ma3h5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-658299879',owner_user_name='tempest-TestVolumeSwap-658299879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8bcb7c9d0e4134b98ab1124efa2b78',uuid=a8105968-7ab2-4423-8596-36996d55397f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converting VIF {"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lazy-loading 'pci_devices' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:05:58 user nova-compute[75621]:   <uuid>a8105968-7ab2-4423-8596-36996d55397f</uuid>
Nov 27 23:05:58 user nova-compute[75621]:   <name>instance-00000011</name>
Nov 27 23:05:58 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:05:58 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:05:58 user nova-compute[75621]:   <metadata>
Nov 27 23:05:58 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:05:58 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:name>tempest-TestVolumeSwap-server-2132521757</nova:name>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:05:58</nova:creationTime>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:05:58 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:05:58 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:owner>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:user uuid="7c8bcb7c9d0e4134b98ab1124efa2b78">tempest-TestVolumeSwap-658299879-project-member</nova:user>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:project uuid="ca878afb27024c96805509fa25a68ad6">tempest-TestVolumeSwap-658299879</nova:project>
Nov 27 23:05:58 user nova-compute[75621]:       </nova:owner>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:05:58 user nova-compute[75621]:       <nova:ports>
Nov 27 23:05:58 user nova-compute[75621]:         <nova:port uuid="7ac5733a-2058-40e6-9da9-33e12a0c9ac8">
Nov 27 23:05:58 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 23:05:58 user nova-compute[75621]:         </nova:port>
Nov 27 23:05:58 user nova-compute[75621]:       </nova:ports>
Nov 27 23:05:58 user nova-compute[75621]:     </nova:instance>
Nov 27 23:05:58 user nova-compute[75621]:   </metadata>
Nov 27 23:05:58 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:05:58 user nova-compute[75621]:     <system>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="serial">a8105968-7ab2-4423-8596-36996d55397f</entry>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="uuid">a8105968-7ab2-4423-8596-36996d55397f</entry>
Nov 27 23:05:58 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:05:58 user nova-compute[75621]:     </system>
Nov 27 23:05:58 user nova-compute[75621]:   </sysinfo>
Nov 27 23:05:58 user nova-compute[75621]:   <os>
Nov 27 23:05:58 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:05:58 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:05:58 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:05:58 user nova-compute[75621]:   </os>
Nov 27 23:05:58 user nova-compute[75621]:   <features>
Nov 27 23:05:58 user nova-compute[75621]:     <acpi/>
Nov 27 23:05:58 user nova-compute[75621]:     <apic/>
Nov 27 23:05:58 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:05:58 user nova-compute[75621]:   </features>
Nov 27 23:05:58 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:05:58 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:05:58 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:05:58 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:05:58 user nova-compute[75621]:   </clock>
Nov 27 23:05:58 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:05:58 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:05:58 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:05:58 user nova-compute[75621]:   </cpu>
Nov 27 23:05:58 user nova-compute[75621]:   <devices>
Nov 27 23:05:58 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:05:58 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:05:58 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk"/>
Nov 27 23:05:58 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:05:58 user nova-compute[75621]:     </disk>
Nov 27 23:05:58 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:05:58 user nova-compute[75621]:       <mac address="fa:16:3e:3f:6d:3f"/>
Nov 27 23:05:58 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:58 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:05:58 user nova-compute[75621]:       <target dev="tap7ac5733a-20"/>
Nov 27 23:05:58 user nova-compute[75621]:     </interface>
Nov 27 23:05:58 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:05:58 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/console.log" append="off"/>
Nov 27 23:05:58 user nova-compute[75621]:     </serial>
Nov 27 23:05:58 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:05:58 user nova-compute[75621]:     <video>
Nov 27 23:05:58 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:05:58 user nova-compute[75621]:     </video>
Nov 27 23:05:58 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:05:58 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:05:58 user nova-compute[75621]:     </rng>
Nov 27 23:05:58 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:05:58 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:05:58 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:05:58 user nova-compute[75621]:     </memballoon>
Nov 27 23:05:58 user nova-compute[75621]:   </devices>
Nov 27 23:05:58 user nova-compute[75621]: </domain>
Nov 27 23:05:58 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2132521757',display_name='tempest-TestVolumeSwap-server-2132521757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2132521757',id=17,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuni9XGmpKMfrSj/y0BwkcQJFrVBUk3TdYvqKEErkuNC/8/yy9GXdTwvDCVQf4iyx6NFBsijrWfZC39TGE4tAz06R3K1jwCMLws2r2v/b3n5nTOw0AMkUN2nfmFvvpVUA==',key_name='tempest-keypair-1854963224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ca878afb27024c96805509fa25a68ad6',ramdisk_id='',reservation_id='r-04ma3h5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-658299879',owner_user_name='tempest-TestVolumeSwap-658299879-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:05:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8bcb7c9d0e4134b98ab1124efa2b78',uuid=a8105968-7ab2-4423-8596-36996d55397f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converting VIF {"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG os_vif [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33207c93-1e73-5ff1-bc8e-7cbb82d45478', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ac5733a-20, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ac5733a-20, col_values=(('qos', UUID('fb041312-e820-4d21-b0ea-f45558dd00d3')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ac5733a-20, col_values=(('external_ids', {'iface-id': '7ac5733a-2058-40e6-9da9-33e12a0c9ac8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:6d:3f', 'vm-uuid': 'a8105968-7ab2-4423-8596-36996d55397f'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: INFO os_vif [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20')
Nov 27 23:05:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] No VIF found with MAC fa:16:3e:3f:6d:3f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updated VIF entry in instance network info cache for port 7ac5733a-2058-40e6-9da9-33e12a0c9ac8. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updating instance_info_cache with network_info: [{"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:05:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-187c13e1-9ac7-4fcd-8fb9-fad14dbc6373 req-f3e8868f-8fa2-45fe-a83f-3bf0ee814a9d service nova] Releasing lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:05:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:05:59 user nova-compute[75621]: INFO nova.compute.claims [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Claim successful on node user
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] No waiting events found dispatching network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:00 user nova-compute[75621]: WARNING nova.compute.manager [req-4f77bcfe-1bf7-4aab-976c-8f4cf36a6f88 req-5880bc7b-8c3a-4864-9f74-d5427f5733fa service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received unexpected event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 for instance with vm_state building and task_state spawning.
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:06:00 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:06:00 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Creating image(s)
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG nova.policy [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bd541264d3d49d4a6af59c1fc0765d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1cd748f87c4bb89ed90e11966cf34c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:06:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.219s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.224s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk 1073741824" returned: 0 in 0.052s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Cannot resize image /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Ensure instance console log exists: /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:06:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] Instance spawned successfully.
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:02 user nova-compute[75621]: INFO nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Took 7.15 seconds to spawn the instance on the hypervisor.
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:06:02 user nova-compute[75621]: INFO nova.compute.manager [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Took 8.38 seconds to build instance.
Nov 27 23:06:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ede74bdf-9e48-473b-933d-94c483f60feb tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.542s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Successfully created port: 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] No waiting events found dispatching network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:02 user nova-compute[75621]: WARNING nova.compute.manager [req-62b10dac-fbfe-4310-99f9-65ec83d8a357 req-70609d6c-fa5e-4ac3-aaa2-4b29dcf7e14d service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received unexpected event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 for instance with vm_state active and task_state None.
Nov 27 23:06:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Successfully updated port: 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance network_info: |[{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start _get_guest_xml network_info=[{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:06:03 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:03 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1425970357',display_name='tempest-ServerStableDeviceRescueTest-server-1425970357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1425970357',id=18,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq5yF8DSj7abh0f8z8HoIS9bHyO3inf8ShuA1FDnHEUIbSWMrEIi/hPpoLYLBr0EFqZ4um0kWCoydZrS/bUq8hKtwxF5akLVEPB60+Bz4gtIIqE4sWE1du5C7RJSr7t6w==',key_name='tempest-keypair-17915930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe1cd748f87c4bb89ed90e11966cf34c',ramdisk_id='',reservation_id='r-0ozdxk1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-784559379',owner_user_name='tempest-ServerStableDeviceRescueTest-784559379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bd541264d3d49d4a6af59c1fc0765d7',uuid=c536051b-9b80-4df7-8903-3b0db3a9050e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converting VIF {"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.objects.instance [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'pci_devices' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:06:03 user nova-compute[75621]:   <uuid>c536051b-9b80-4df7-8903-3b0db3a9050e</uuid>
Nov 27 23:06:03 user nova-compute[75621]:   <name>instance-00000012</name>
Nov 27 23:06:03 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:06:03 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:06:03 user nova-compute[75621]:   <metadata>
Nov 27 23:06:03 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:06:03 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1425970357</nova:name>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:06:03</nova:creationTime>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:06:03 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:06:03 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:owner>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:user uuid="1bd541264d3d49d4a6af59c1fc0765d7">tempest-ServerStableDeviceRescueTest-784559379-project-member</nova:user>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:project uuid="fe1cd748f87c4bb89ed90e11966cf34c">tempest-ServerStableDeviceRescueTest-784559379</nova:project>
Nov 27 23:06:03 user nova-compute[75621]:       </nova:owner>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:06:03 user nova-compute[75621]:       <nova:ports>
Nov 27 23:06:03 user nova-compute[75621]:         <nova:port uuid="41832a48-3bfe-4379-b729-eb69507911ef">
Nov 27 23:06:03 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:06:03 user nova-compute[75621]:         </nova:port>
Nov 27 23:06:03 user nova-compute[75621]:       </nova:ports>
Nov 27 23:06:03 user nova-compute[75621]:     </nova:instance>
Nov 27 23:06:03 user nova-compute[75621]:   </metadata>
Nov 27 23:06:03 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:06:03 user nova-compute[75621]:     <system>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="serial">c536051b-9b80-4df7-8903-3b0db3a9050e</entry>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="uuid">c536051b-9b80-4df7-8903-3b0db3a9050e</entry>
Nov 27 23:06:03 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:06:03 user nova-compute[75621]:     </system>
Nov 27 23:06:03 user nova-compute[75621]:   </sysinfo>
Nov 27 23:06:03 user nova-compute[75621]:   <os>
Nov 27 23:06:03 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:06:03 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:06:03 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:06:03 user nova-compute[75621]:   </os>
Nov 27 23:06:03 user nova-compute[75621]:   <features>
Nov 27 23:06:03 user nova-compute[75621]:     <acpi/>
Nov 27 23:06:03 user nova-compute[75621]:     <apic/>
Nov 27 23:06:03 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:06:03 user nova-compute[75621]:   </features>
Nov 27 23:06:03 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:06:03 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:06:03 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:06:03 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:06:03 user nova-compute[75621]:   </clock>
Nov 27 23:06:03 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:06:03 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:06:03 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:06:03 user nova-compute[75621]:   </cpu>
Nov 27 23:06:03 user nova-compute[75621]:   <devices>
Nov 27 23:06:03 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:06:03 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:06:03 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk"/>
Nov 27 23:06:03 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:06:03 user nova-compute[75621]:     </disk>
Nov 27 23:06:03 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:06:03 user nova-compute[75621]:       <mac address="fa:16:3e:40:dd:9e"/>
Nov 27 23:06:03 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:03 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:06:03 user nova-compute[75621]:       <target dev="tap41832a48-3b"/>
Nov 27 23:06:03 user nova-compute[75621]:     </interface>
Nov 27 23:06:03 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:06:03 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/console.log" append="off"/>
Nov 27 23:06:03 user nova-compute[75621]:     </serial>
Nov 27 23:06:03 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:06:03 user nova-compute[75621]:     <video>
Nov 27 23:06:03 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:03 user nova-compute[75621]:     </video>
Nov 27 23:06:03 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:06:03 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:06:03 user nova-compute[75621]:     </rng>
Nov 27 23:06:03 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:06:03 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:06:03 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:06:03 user nova-compute[75621]:     </memballoon>
Nov 27 23:06:03 user nova-compute[75621]:   </devices>
Nov 27 23:06:03 user nova-compute[75621]: </domain>
Nov 27 23:06:03 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1425970357',display_name='tempest-ServerStableDeviceRescueTest-server-1425970357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1425970357',id=18,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq5yF8DSj7abh0f8z8HoIS9bHyO3inf8ShuA1FDnHEUIbSWMrEIi/hPpoLYLBr0EFqZ4um0kWCoydZrS/bUq8hKtwxF5akLVEPB60+Bz4gtIIqE4sWE1du5C7RJSr7t6w==',key_name='tempest-keypair-17915930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe1cd748f87c4bb89ed90e11966cf34c',ramdisk_id='',reservation_id='r-0ozdxk1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-784559379',owner_user_name='tempest-ServerStableDeviceRescueTest-784559379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bd541264d3d49d4a6af59c1fc0765d7',uuid=c536051b-9b80-4df7-8903-3b0db3a9050e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converting VIF {"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG os_vif [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c072f2c-3c6f-54b4-8711-a6eaa25445e8', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41832a48-3b, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41832a48-3b, col_values=(('qos', UUID('972acfd5-3cf1-433a-8aaa-81620e42c1d5')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41832a48-3b, col_values=(('external_ids', {'iface-id': '41832a48-3bfe-4379-b729-eb69507911ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:dd:9e', 'vm-uuid': 'c536051b-9b80-4df7-8903-3b0db3a9050e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:03 user nova-compute[75621]: INFO os_vif [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b')
Nov 27 23:06:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No VIF found with MAC fa:16:3e:40:dd:9e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-changed-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing instance network info cache due to event network-changed-41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:06:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updated VIF entry in instance network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9fcef206-dddf-4335-a20f-0d351d6f9e1f req-fd2c411f-6211-411f-82a0-1672548bcbcf service nova] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:05 user nova-compute[75621]: WARNING nova.compute.manager [req-77c0dc3d-4072-4cdb-8ed7-5e6859669086 req-d1967b8e-2822-48c2-8752-698a757ec587 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state building and task_state spawning.
Nov 27 23:06:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:06:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance spawned successfully.
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:07 user nova-compute[75621]: INFO nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Took 7.14 seconds to spawn the instance on the hypervisor.
Nov 27 23:06:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:08 user nova-compute[75621]: WARNING nova.compute.manager [req-404526df-c827-4197-8973-8ce752beff5a req-c4a5923d-29df-402f-b785-e9476370b6fe service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state building and task_state spawning.
Nov 27 23:06:08 user nova-compute[75621]: INFO nova.compute.manager [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Took 8.25 seconds to build instance.
Nov 27 23:06:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-85ab052b-3ac6-4926-9115-85ed1461ec95 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.462s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:12 user nova-compute[75621]: INFO nova.compute.manager [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Terminating instance
Nov 27 23:06:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Instance destroyed successfully.
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.objects.instance [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'resources' on Instance uuid 52b096b8-1aab-494d-a4eb-becbf8313dd3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2078187981',display_name='tempest-VolumesAdminNegativeTest-server-2078187981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2078187981',id=13,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:04:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-x4kn4f4l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:04:23Z,user_data=None,user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=52b096b8-1aab-494d-a4eb-becbf8313dd3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "address": "fa:16:3e:b7:9e:e0", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c8bc8e6-50", "ovs_interfaceid": "3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG os_vif [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c8bc8e6-50, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f67bf55-2f7f-4802-a52e-7f1005c48409) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:13 user nova-compute[75621]: INFO os_vif [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:9e:e0,bridge_name='br-int',has_traffic_filtering=True,id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c8bc8e6-50')
Nov 27 23:06:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Deleting instance files /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3_del
Nov 27 23:06:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Deletion of /opt/stack/data/nova/instances/52b096b8-1aab-494d-a4eb-becbf8313dd3_del complete
Nov 27 23:06:13 user nova-compute[75621]: INFO nova.compute.manager [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Took 1.01 seconds to destroy the instance on the hypervisor.
Nov 27 23:06:13 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:06:13 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-f5ebd6a4-89d8-4290-87c0-505a4b981a18 req-41891e73-315b-4de9-8366-f6fb8cf1320f service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Received event network-vif-deleted-3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:14 user nova-compute[75621]: INFO nova.compute.manager [req-f5ebd6a4-89d8-4290-87c0-505a4b981a18 req-41891e73-315b-4de9-8366-f6fb8cf1320f service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Neutron deleted interface 3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b; detaching it from the instance and deleting it from the info cache
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.network.neutron [req-f5ebd6a4-89d8-4290-87c0-505a4b981a18 req-41891e73-315b-4de9-8366-f6fb8cf1320f service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:14 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Took 0.62 seconds to deallocate network for instance.
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-f5ebd6a4-89d8-4290-87c0-505a4b981a18 req-41891e73-315b-4de9-8366-f6fb8cf1320f service nova] [instance: 52b096b8-1aab-494d-a4eb-becbf8313dd3] Detach interface failed, port_id=3c8bc8e6-50d8-46f0-9ec4-810e63ecf90b, reason: Instance 52b096b8-1aab-494d-a4eb-becbf8313dd3 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-changed-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing instance network info cache due to event network-changed-27cd43be-7423-4cda-ba31-f7a17e03f6ee. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] Acquiring lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] Acquired lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG nova.network.neutron [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Refreshing network info cache for port 27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:15 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Deleted allocations for instance 52b096b8-1aab-494d-a4eb-becbf8313dd3
Nov 27 23:06:15 user nova-compute[75621]: DEBUG nova.network.neutron [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updated VIF entry in instance network info cache for port 27cd43be-7423-4cda-ba31-f7a17e03f6ee. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG nova.network.neutron [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d07b5755-b0ce-4536-838e-dd5681c8e5b9 req-eae58b0a-dc69-49c8-b61a-92d31ee876f9 service nova] Releasing lock "refresh_cache-1fe93184-5f27-493e-a456-3606f33f5c23" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0269ca79-444a-4318-a523-71c7fae43622 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "52b096b8-1aab-494d-a4eb-becbf8313dd3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.468s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:16 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:06:16 user nova-compute[75621]: INFO nova.compute.claims [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Claim successful on node user
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.541s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:06:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:17 user nova-compute[75621]: INFO nova.compute.manager [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Terminating instance
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:06:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Creating image(s)
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.policy [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22a7b251f7b641e184d1fc8bb44562b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3b221a362d4bd6b7a057c97513a70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3832e67a-7651-4849-be75-3a7e00249cfb req-4e14ebe5-6d9e-4635-9a20-e1feab6dac8e service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-49e641d2-2e57-4a6d-b7d5-96565dfdcd2c req-2ffb39bc-ff9b-45b0-b4b0-a6c3681e42f1 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.part --force-share --output=json" returned: 0 in 0.229s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.virt.images [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] 6b169800-4748-4605-a719-b42ec98e471d was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.part /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.part /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.converted" returned: 0 in 0.229s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f0e0356-0f70-4f10-b698-e6e18ef5b528 req-3114d295-b894-4e9d-a635-ac182b2da1dd service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.460s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json" returned: 0 in 0.238s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json" returned: 0 in 0.241s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4,backing_fmt=raw /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Successfully created port: 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4,backing_fmt=raw /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk 1073741824" returned: 0 in 0.134s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "47901a02d095a2c92c899fa181e3da6f328ddbe4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.387s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Instance destroyed successfully.
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lazy-loading 'resources' on Instance uuid 1fe93184-5f27-493e-a456-3606f33f5c23 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27cd43be-74, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json" returned: 0 in 0.266s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee57c1c8-2819-40b8-a4f8-8772bd02dabd) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:af:96,bridge_name='br-int',has_traffic_filtering=True,id=27cd43be-7423-4cda-ba31-f7a17e03f6ee,network=Network(e072a128-1c3e-420d-bbc2-712335a0f90d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27cd43be-74')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b8ca471-2a, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Cannot resize image /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Ensure instance console log exists: /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.006s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f035ecc-31be-403f-ae7e-65133e4187ea) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:1f:b7,bridge_name='br-int',has_traffic_filtering=True,id=7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7b8ca471-2a')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24e9c835-93, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c for instance with vm_state active and task_state deleting.
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-24e9c835-932d-457a-9d46-7dde72d964df for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-24e9c835-932d-457a-9d46-7dde72d964df for instance with vm_state active and task_state deleting.
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 for instance with vm_state active and task_state deleting.
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-069bee22-5acb-47ee-b58d-61642f7313ab for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-069bee22-5acb-47ee-b58d-61642f7313ab for instance with vm_state active and task_state deleting.
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-unplugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9e5c3e29-d519-4f41-b619-710c41e92a49 req-39e1f350-b69c-4258-be5b-38be6d5301e4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-unplugged-18d1ecf2-c45c-4910-9633-0c089367122d for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bad66eaa-b3ce-42e0-8b94-8bf83788e861) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:ad:22,bridge_name='br-int',has_traffic_filtering=True,id=24e9c835-932d-457a-9d46-7dde72d964df,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap24e9c835-93')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "address": "fa:16:3e:0a:3c:13", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.120", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ef8ac6f-fa", "ovs_interfaceid": "7ef8ac6f-fa30-47cf-acdb-7c2377b15192", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ef8ac6f-fa, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fbb71760-6b04-404a-90ae-5adc5e552e3b) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:3c:13,bridge_name='br-int',has_traffic_filtering=True,id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ef8ac6f-fa')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap069bee22-5a, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ff21c2d-09ca-487d-9f84-87e70f5bdc92) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:83:6c,bridge_name='br-int',has_traffic_filtering=True,id=069bee22-5acb-47ee-b58d-61642f7313ab,network=Network(3b4ff053-085a-40c0-aff3-c6ac083f3634),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap069bee22-5a')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18d1ecf2-c4, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=605b9463-8e8c-494e-a4c1-4aca25bc0f99) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5c:de,bridge_name='br-int',has_traffic_filtering=True,id=18d1ecf2-c45c-4910-9633-0c089367122d,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap18d1ecf2-c4')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-27T23:04:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1477975072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1477975072',id=14,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAd0Ecp9RsGx1d8m7uSIf7mpOA06r57AE9r+VSPyaDTgz+toVC40A59ktslMnH8IlCTVMuO0lbGsvPuagbQUCsvV6JqqU+cjLu8dtpH2lDKEbeGjiNQ+lWdw6t70lu3Gkg==',key_name='tempest-keypair-34202340',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86b7693a0b2b447e944fc201f80241a1',ramdisk_id='',reservation_id='r-dlnj01v3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1263128950',owner_user_name='tempest-TaggedBootDevicesTest-1263128950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c012c6799710443c938fb052e6f06a01',uuid=1fe93184-5f27-493e-a456-3606f33f5c23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converting VIF {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d7addf1-53, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38bb1c43-c2b1-4125-815f-da4d867c7aaf) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:20 user nova-compute[75621]: INFO os_vif [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0a:dd,bridge_name='br-int',has_traffic_filtering=True,id=0d7addf1-53ea-4f62-8d7e-5654c5e02578,network=Network(3c193afd-deba-4388-8e73-c64519d1849e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7addf1-53')
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VOGlrwXM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f3fcb-7442-42db-8dc1-95cbbc4a8ab9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:20 user nova-compute[75621]: No targets found.
Nov 27 23:06:20 user nova-compute[75621]: iSNS:
Nov 27 23:06:20 user nova-compute[75621]: No targets found.
Nov 27 23:06:20 user nova-compute[75621]: STATIC:
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef
Nov 27 23:06:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:20 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:20 user nova-compute[75621]: No targets found.
Nov 27 23:06:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:20 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:20 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:20 user nova-compute[75621]: WARNING nova.compute.manager [req-2b0af16c-901c-4cbd-81ee-9ae3c7d6bcbc req-81dfbea1-5c43-4954-9ad5-f053e20c5072 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-27cd43be-7423-4cda-ba31-f7a17e03f6ee for instance with vm_state active and task_state deleting.
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.034s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f67bb38-5424-4dea-923f-17d69beea57a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2c8fbf-8cf1-48aa-bddd-025e51fbfc75]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:20 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e068e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[44efd805-6bc9-432e-a5ca-e871019162ed]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e376a76-3060-491b-8b17-b10a8b3fdcfb]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a9348f-7033-4de7-829e-9fa86f2d0cfd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1024d13e-aa26-4cac-aee3-73dde7d75db8]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2102be0-dd2a-40d3-b22d-65c94e76dce3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Successfully updated port: 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --logout" returned: 0 in 0.100s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea6935e-a4a2-49f6-b12f-8105c276180d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260]
Nov 27 23:06:20 user nova-compute[75621]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:21 user nova-compute[75621]: WARNING nova.compute.manager [req-ec28c654-521b-4e9b-be9b-c78e281fd829 req-4e95ced8-acd6-455f-b6a9-8ada5e60bb6c service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-0d7addf1-53ea-4f62-8d7e-5654c5e02578 for instance with vm_state active and task_state deleting.
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bb736b2-15c9-4074-a468-052dedf8fdef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bb5fab-5919-4421-9151-12a6ed3ebc3a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== disconnect_volume: return (439ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tCADVBHG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:21 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e0010-95ae-4ca9-88bf-fbfca7b45ac6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]: iSNS:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]: STATIC:
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:21 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:21 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef541a66-ef09-4996-aa64-e349238f2c77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e84bf94-eb95-46fe-bb71-6e6ad2e84db2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13000f5750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[483d9d98-b98b-4912-a59a-b0d7ebd3da96]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ae228-3a3b-4a7d-aab1-04e26c8db3c7]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f199b89-6a99-4ea3-bf49-6feebbc8b688]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aecc1759-0f39-45af-b263-43b71e48ca48]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance network_info: |[{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start _get_guest_xml network_info=[{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:06:13Z,direct_url=<?>,disk_format='qcow2',id=6b169800-4748-4605-a719-b42ec98e471d,min_disk=0,min_ram=0,name='tempest-scenario-img--1438808220',owner='9b3b221a362d4bd6b7a057c97513a70b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:06:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6b169800-4748-4605-a719-b42ec98e471d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:06:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:21 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e811c902-22cb-4d08-b0b8-24e6bd9974e5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:06:13Z,direct_url=<?>,disk_format='qcow2',id=6b169800-4748-4605-a719-b42ec98e471d,min_disk=0,min_ram=0,name='tempest-scenario-img--1438808220',owner='9b3b221a362d4bd6b7a057c97513a70b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:06:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:17Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:06:21 user nova-compute[75621]:   <uuid>68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</uuid>
Nov 27 23:06:21 user nova-compute[75621]:   <name>instance-00000013</name>
Nov 27 23:06:21 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:06:21 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:06:21 user nova-compute[75621]:   <metadata>
Nov 27 23:06:21 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:06:21 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:name>tempest-TestMinimumBasicScenario-server-1880807968</nova:name>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:06:21</nova:creationTime>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:06:21 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:06:21 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:owner>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:user uuid="22a7b251f7b641e184d1fc8bb44562b9">tempest-TestMinimumBasicScenario-1822102155-project-member</nova:user>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:project uuid="9b3b221a362d4bd6b7a057c97513a70b">tempest-TestMinimumBasicScenario-1822102155</nova:project>
Nov 27 23:06:21 user nova-compute[75621]:       </nova:owner>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:root type="image" uuid="6b169800-4748-4605-a719-b42ec98e471d"/>
Nov 27 23:06:21 user nova-compute[75621]:       <nova:ports>
Nov 27 23:06:21 user nova-compute[75621]:         <nova:port uuid="80fb97ee-75ec-475b-86f0-78e09f6c177b">
Nov 27 23:06:21 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:06:21 user nova-compute[75621]:         </nova:port>
Nov 27 23:06:21 user nova-compute[75621]:       </nova:ports>
Nov 27 23:06:21 user nova-compute[75621]:     </nova:instance>
Nov 27 23:06:21 user nova-compute[75621]:   </metadata>
Nov 27 23:06:21 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:06:21 user nova-compute[75621]:     <system>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="serial">68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</entry>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="uuid">68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</entry>
Nov 27 23:06:21 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:06:21 user nova-compute[75621]:     </system>
Nov 27 23:06:21 user nova-compute[75621]:   </sysinfo>
Nov 27 23:06:21 user nova-compute[75621]:   <os>
Nov 27 23:06:21 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:06:21 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:06:21 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:06:21 user nova-compute[75621]:   </os>
Nov 27 23:06:21 user nova-compute[75621]:   <features>
Nov 27 23:06:21 user nova-compute[75621]:     <acpi/>
Nov 27 23:06:21 user nova-compute[75621]:     <apic/>
Nov 27 23:06:21 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:06:21 user nova-compute[75621]:   </features>
Nov 27 23:06:21 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:06:21 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:06:21 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:06:21 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:06:21 user nova-compute[75621]:   </clock>
Nov 27 23:06:21 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:06:21 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:06:21 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:06:21 user nova-compute[75621]:   </cpu>
Nov 27 23:06:21 user nova-compute[75621]:   <devices>
Nov 27 23:06:21 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:06:21 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:06:21 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk"/>
Nov 27 23:06:21 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:06:21 user nova-compute[75621]:     </disk>
Nov 27 23:06:21 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:06:21 user nova-compute[75621]:       <mac address="fa:16:3e:53:e7:12"/>
Nov 27 23:06:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:21 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:06:21 user nova-compute[75621]:       <target dev="tap80fb97ee-75"/>
Nov 27 23:06:21 user nova-compute[75621]:     </interface>
Nov 27 23:06:21 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:06:21 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/console.log" append="off"/>
Nov 27 23:06:21 user nova-compute[75621]:     </serial>
Nov 27 23:06:21 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:06:21 user nova-compute[75621]:     <video>
Nov 27 23:06:21 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:21 user nova-compute[75621]:     </video>
Nov 27 23:06:21 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:06:21 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:06:21 user nova-compute[75621]:     </rng>
Nov 27 23:06:21 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:06:21 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:06:21 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:06:21 user nova-compute[75621]:     </memballoon>
Nov 27 23:06:21 user nova-compute[75621]:   </devices>
Nov 27 23:06:21 user nova-compute[75621]: </domain>
Nov 27 23:06:21 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:17Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_vif [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8da9045e-3ab4-5175-9c29-0d67213ce7ca', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b824e-8d2d-4a96-84ae-b011df966de8]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260]
Nov 27 23:06:21 user nova-compute[75621]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80fb97ee-75, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80fb97ee-75, col_values=(('qos', UUID('0b2c7974-49a2-4c4b-a329-0d1644db084d')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80fb97ee-75, col_values=(('external_ids', {'iface-id': '80fb97ee-75ec-475b-86f0-78e09f6c177b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:e7:12', 'vm-uuid': '68e5429b-9bdf-4f71-8a6b-fd446c8a08a2'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:21 user nova-compute[75621]: INFO os_vif [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75')
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0fd4c35-4264-42b3-a76a-0a506cac4681 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b9327b-f4e8-4c62-9bc7-b260a30ff34a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.435s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== disconnect_volume: return (436ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rxViRKvU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:21 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[528f8bcd-6f2e-4c06-bc6d-3b3226aa1cc3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]: iSNS:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]: STATIC:
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928
Nov 27 23:06:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:21 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:21 user nova-compute[75621]: No targets found.
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:21 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:21 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No VIF found with MAC fa:16:3e:53:e7:12, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b994c1-5011-4523-9403-b4620197cfda]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[831aa701-aa91-49ec-b45e-f7d6581385f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ad952e7-80c5-47d4-a21e-a3174ef0d6fd (non-flash)
Nov 27 23:06:21 user nova-compute[75621]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd0d91db-4f12-4026-b828-b761121d9928 (non-flash)
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07971c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfc4d29-2587-401b-9014-ce223097a346]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1b5eed-3024-40ff-aa40-6abad58bc56e]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1640676c-8572-4cbd-a132-58cd131f1af3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51835de7-7fb7-4f75-90e1-44ed51c5fb2b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bb338d-ba7e-4eb4-8263-a496efb2bc9c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdf5324-515a-4976-9c86-7d8efe6bfebf]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260]
Nov 27 23:06:21 user nova-compute[75621]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eee7749b-be40-4ef4-ac4c-afc46c3bdf37 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[568dab90-30d2-4db5-ba4e-09aaa6ab0014]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] <== disconnect_volume: return (375ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Deleting instance files /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23_del
Nov 27 23:06:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Deletion of /opt/stack/data/nova/instances/1fe93184-5f27-493e-a456-3606f33f5c23_del complete
Nov 27 23:06:21 user nova-compute[75621]: INFO nova.compute.manager [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Took 4.49 seconds to destroy the instance on the hypervisor.
Nov 27 23:06:21 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:06:21 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] Acquiring lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] Lock "1fe93184-5f27-493e-a456-3606f33f5c23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] No waiting events found dispatching network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:22 user nova-compute[75621]: WARNING nova.compute.manager [req-433cd8af-2f2f-4c02-b0f0-680731509388 req-bd5a6566-36f0-467e-aee0-3a253e761dc4 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received unexpected event network-vif-plugged-18d1ecf2-c45c-4910-9633-0c089367122d for instance with vm_state active and task_state deleting.
Nov 27 23:06:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing instance network info cache due to event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG nova.network.neutron [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updated VIF entry in instance network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG nova.network.neutron [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e05e29d2-58b8-42bf-93cc-203beaa3e4fd req-588b65a6-f619-4c2e-9107-b46923d0cf1f service nova] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:24 user nova-compute[75621]: WARNING nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state building and task_state spawning.
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:24 user nova-compute[75621]: WARNING nova.compute.manager [req-e78640ab-f8d8-4dc3-9409-0c53e4f3bbb2 req-c06f4ed7-012e-47ca-833f-177eaf0b9b8b service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state building and task_state spawning.
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-deleted-7ef8ac6f-fa30-47cf-acdb-7c2377b15192 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:24 user nova-compute[75621]: INFO nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Neutron deleted interface 7ef8ac6f-fa30-47cf-acdb-7c2377b15192; detaching it from the instance and deleting it from the info cache
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.network.neutron [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "address": "fa:16:3e:34:af:96", "network": {"id": "e072a128-1c3e-420d-bbc2-712335a0f90d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-550976069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27cd43be-74", "ovs_interfaceid": "27cd43be-7423-4cda-ba31-f7a17e03f6ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Detach interface failed, port_id=7ef8ac6f-fa30-47cf-acdb-7c2377b15192, reason: Instance 1fe93184-5f27-493e-a456-3606f33f5c23 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-deleted-27cd43be-7423-4cda-ba31-f7a17e03f6ee {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:24 user nova-compute[75621]: INFO nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Neutron deleted interface 27cd43be-7423-4cda-ba31-f7a17e03f6ee; detaching it from the instance and deleting it from the info cache
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.network.neutron [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [{"id": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "address": "fa:16:3e:89:1f:b7", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.65", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b8ca471-2a", "ovs_interfaceid": "7b8ca471-2a40-4e6f-b3b0-de5b2e45a29c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "24e9c835-932d-457a-9d46-7dde72d964df", "address": "fa:16:3e:8f:ad:22", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24e9c835-93", "ovs_interfaceid": "24e9c835-932d-457a-9d46-7dde72d964df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "069bee22-5acb-47ee-b58d-61642f7313ab", "address": "fa:16:3e:ff:83:6c", "network": {"id": "3b4ff053-085a-40c0-aff3-c6ac083f3634", "bridge": "br-int", "label": "tempest-device-tagging-net1-288788882", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap069bee22-5a", "ovs_interfaceid": "069bee22-5acb-47ee-b58d-61642f7313ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "18d1ecf2-c45c-4910-9633-0c089367122d", "address": "fa:16:3e:b0:5c:de", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18d1ecf2-c4", "ovs_interfaceid": "18d1ecf2-c45c-4910-9633-0c089367122d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "address": "fa:16:3e:e4:0a:dd", "network": {"id": "3c193afd-deba-4388-8e73-c64519d1849e", "bridge": "br-int", "label": "tempest-device-tagging-net2-1985862234", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "86b7693a0b2b447e944fc201f80241a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7addf1-53", "ovs_interfaceid": "0d7addf1-53ea-4f62-8d7e-5654c5e02578", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-9765eac7-ac0e-4b1e-b47e-771ea6367922 req-14d16355-95bd-4052-b6ba-6c5df6ae2b9a service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Detach interface failed, port_id=27cd43be-7423-4cda-ba31-f7a17e03f6ee, reason: Instance 1fe93184-5f27-493e-a456-3606f33f5c23 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:06:25 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance spawned successfully.
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:25 user nova-compute[75621]: INFO nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:06:25 user nova-compute[75621]: INFO nova.compute.manager [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Took 8.66 seconds to build instance.
Nov 27 23:06:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5914b325-bb5b-427b-a2a3-1048ad3c0fbd tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.786s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:25 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:25 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Took 3.62 seconds to deallocate network for instance.
Nov 27 23:06:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-bf7fe1b3-794c-4e7a-8383-d8aea25d28b5 req-5671561e-ab76-4baf-9dc7-dd9a22de0211 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-deleted-0d7addf1-53ea-4f62-8d7e-5654c5e02578 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-bf7fe1b3-794c-4e7a-8383-d8aea25d28b5 req-5671561e-ab76-4baf-9dc7-dd9a22de0211 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-deleted-18d1ecf2-c45c-4910-9633-0c089367122d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:26 user nova-compute[75621]: DEBUG nova.compute.manager [req-bf7fe1b3-794c-4e7a-8383-d8aea25d28b5 req-5671561e-ab76-4baf-9dc7-dd9a22de0211 service nova] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Received event network-vif-deleted-069bee22-5acb-47ee-b58d-61642f7313ab {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:28 user nova-compute[75621]: INFO nova.compute.manager [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] [instance: 1fe93184-5f27-493e-a456-3606f33f5c23] Took 2.89 seconds to detach 3 volumes for instance.
Nov 27 23:06:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.687s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:29 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Deleted allocations for instance 1fe93184-5f27-493e-a456-3606f33f5c23
Nov 27 23:06:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c3fd92e8-33ca-4949-9286-29e27bb5d3e6 tempest-TaggedBootDevicesTest-1263128950 tempest-TaggedBootDevicesTest-1263128950-project-member] Lock "1fe93184-5f27-493e-a456-3606f33f5c23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.005s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-changed-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Refreshing instance network info cache due to event network-changed-4a4ff5fc-0b77-4dba-b146-0ae201275cb9. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:06:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] Acquiring lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] Acquired lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Refreshing network info cache for port 4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.023s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updated VIF entry in instance network info cache for port 4a4ff5fc-0b77-4dba-b146-0ae201275cb9. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating instance_info_cache with network_info: [{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG nova.objects.instance [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'flavor' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83b4db6e-fc51-490f-a0d5-cc1cb5efe398 req-4a3a1922-33a0-406a-a164-ce8ce14f1a89 service nova] Releasing lock "refresh_cache-ee90a2b7-403e-46ae-ab6b-a1caf604a98b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.147s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:34 user nova-compute[75621]: INFO nova.compute.manager [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attaching volume f542dabd-5266-46fb-a1cf-99903712ee24 to /dev/vdb
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.utils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7d01f5-fb76-4966-b5b9-ddacb83bcd86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5d3c88-a412-4a31-b69d-65f2c0608eb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4ba51e-8ca9-4438-939e-be76eb74d250]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f1c44-8192-4128-866b-aaa25705b4be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:34 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:06:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f298c2-9cd0-4e99-a6dc-33da02058e03]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG os_brick.utils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:34 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating existing volume attachment record: 33cf3198-8d4c-4e83-aada-438841fa3a77 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:06:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Port 37e89c03-0357-46ad-9765-d16725a8dca6 binding to destination host user is already ACTIVE {{(pid=75621) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Creating tmpfile /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/tmplawvocrb to verify with other compute node that the instance is on the same shared storage. {{(pid=75621) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9625}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:41 user nova-compute[75621]: WARNING nova.compute.manager [req-649b7127-b87c-4dee-9804-ff78b3b49e65 req-1b560940-c93d-4f95-8522-a1c73807571d service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:41 user nova-compute[75621]: INFO nova.compute.manager [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Detaching volume 50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:41 user nova-compute[75621]: INFO nova.virt.block_device [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Attempting to driver detach volume 50bfd854-7ced-465f-9682-753bb197abe2 from mountpoint /dev/vdb
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Attempting to detach device vdb from instance b04a6cd0-3193-4b86-8563-1d889000e76e from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:06:41 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:06:41 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:06:41 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:06:41 user nova-compute[75621]:   <serial>50bfd854-7ced-465f-9682-753bb197abe2</serial>
Nov 27 23:06:41 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:06:41 user nova-compute[75621]: </disk>
Nov 27 23:06:41 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:06:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdb from instance b04a6cd0-3193-4b86-8563-1d889000e76e from the persistent domain config.
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b04a6cd0-3193-4b86-8563-1d889000e76e from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:06:41 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:06:41 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:06:41 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:06:41 user nova-compute[75621]:   <serial>50bfd854-7ced-465f-9682-753bb197abe2</serial>
Nov 27 23:06:41 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:06:41 user nova-compute[75621]: </disk>
Nov 27 23:06:41 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:42 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance destroyed successfully.
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'resources' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdfa6ff-524a-4d47-a468-ff03d1e9287c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:06:42 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e89c03-03, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1908bddd-5232-4348-a5bd-2d9f37a0d800) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:42 user nova-compute[75621]: INFO os_vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b203305-2ec4-4145-9d2e-0469fc1d7986]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24] added
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4091dc34-cdc4-463c-84fc-3932e1766022]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f8ae8c-9db8-4a53-a12f-188d6de6b38e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsIZgaC {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsIZgaC" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1b7550-0b58-4892-b1ed-f0a989cdbaeb]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iTsIZgaC'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7ad80b-4a94-499b-8ab5-852c66891734]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03ab456-7872-4ef4-b16b-a65614cf199c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[22639f70-3775-4906-b2a1-e5491189d7db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]
Nov 27 23:06:42 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b0f89-c97d-42f1-8537-9da960b07037]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e2bea4-edf7-46ef-8c80-f4474ce240b1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:42 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77ab352-617b-4c5b-8a4c-14a1cbddf79d]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:43 user nova-compute[75621]: WARNING nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:43 user nova-compute[75621]: WARNING nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:43 user nova-compute[75621]: WARNING nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:43 user nova-compute[75621]: WARNING nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:43 user nova-compute[75621]: WARNING nova.compute.manager [req-4c0ee641-e478-46ac-9a5e-29a181a1aa54 req-7b189073-3e8b-41e2-b252-3a3cc6e3c26e service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23731643837316232', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731643837316232', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.282s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'flavor' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d892f0-773e-4273-bfd5-be768e5c42e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:43 user nova-compute[75621]: No targets found.
Nov 27 23:06:43 user nova-compute[75621]: iSNS:
Nov 27 23:06:43 user nova-compute[75621]: No targets found.
Nov 27 23:06:43 user nova-compute[75621]: STATIC:
Nov 27 23:06:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:06:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:06:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:43 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:43 user nova-compute[75621]: No targets found.
Nov 27 23:06:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:43 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:43 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:06:43 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:06:43 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:06:43 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:06:43 user nova-compute[75621]:   <serial>f542dabd-5266-46fb-a1cf-99903712ee24</serial>
Nov 27 23:06:43 user nova-compute[75621]: </disk>
Nov 27 23:06:43 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5fe125-30fe-4d08-87f5-a448884dee8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8618b6c-7a46-4147-80e9-85aca964a7c2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:06:43 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0517640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a'): ({'sdg'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Removing single pathed devices sdg {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ce859-cbc0-4dbe-941c-9ff6f111e4b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ef4387-e096-431b-9cc8-876b1b1ca331]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flushing IO for device /dev/sdg {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.011s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae402b58-b93a-4706-b62b-f5cdb0768a99]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[246f64fc-ba58-48e2-8cc5-1fb6a8cbeba7]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d61250-4c35-449e-813c-862970ccd2e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb71ab0-3f20-4bbb-849d-f5f34d2ebc6a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:06:43 user nova-compute[75621]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea9934-d023-4f0c-9c14-bec34b070d1a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== disconnect_volume: return (1627ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:06:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:c3:51:c7, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d8918ef-4c01-4d77-95a1-101aee2d054c tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.616s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'migration_context' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.objects.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Object Instance<db2447ed-f456-41e5-b4bd-2dc243ad6c33> lazy-loaded attributes: resources,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:06:44 user nova-compute[75621]: INFO nova.compute.manager [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Rebuilding instance
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:06:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.506s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:45 user nova-compute[75621]: WARNING nova.compute.manager [req-150777ff-f9d6-44bc-9a0f-cec747f8614e req-5bc57e95-3182-4908-b821-a223aa349db7 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state active and task_state rebuilding.
Nov 27 23:06:45 user nova-compute[75621]: INFO nova.compute.manager [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Swapping old allocation on dict_keys(['6c22fa5b-3db0-4974-9b71-20fe6f488e9f']) held by migration 5f0f7fef-ee48-48e9-9bbf-cd7a7284e13b for instance
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Overwriting current allocation {'allocations': {'6c22fa5b-3db0-4974-9b71-20fe6f488e9f': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 23}}, 'project_id': '776ddd88f0e543769f6e275217231ecd', 'user_id': 'f116260296b94e55916e029d103f2126', 'consumer_generation': 1} on consumer db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:06:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance destroyed successfully.
Nov 27 23:06:45 user nova-compute[75621]: INFO nova.compute.manager [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Detaching volume f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:06:45 user nova-compute[75621]: INFO nova.virt.block_device [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attempting to driver detach volume f542dabd-5266-46fb-a1cf-99903712ee24 from mountpoint /dev/vdb
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Attempting to detach device vdb from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:06:45 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:06:45 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:06:45 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:06:45 user nova-compute[75621]:   <serial>f542dabd-5266-46fb-a1cf-99903712ee24</serial>
Nov 27 23:06:45 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:06:45 user nova-compute[75621]: </disk>
Nov 27 23:06:45 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:06:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully detached device vdb from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the persistent domain config.
Nov 27 23:06:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a8458-6908-4c16-b2c7-717eb1d3f65d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:45 user nova-compute[75621]: No targets found.
Nov 27 23:06:45 user nova-compute[75621]: iSNS:
Nov 27 23:06:45 user nova-compute[75621]: No targets found.
Nov 27 23:06:45 user nova-compute[75621]: STATIC:
Nov 27 23:06:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:06:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:45 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:45 user nova-compute[75621]: No targets found.
Nov 27 23:06:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:45 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:45 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e6c34a-4770-45cf-93cb-e1be08b550c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36eac11-f0e6-48e7-80ad-8f0d645a9245]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:06:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0517b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f55c0-a130-4f0f-a4f5-d81a855dc22b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG nova.network.neutron [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fb487c-cb6b-408d-acd4-6c7dfa6892fa]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.utils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f24630-44d3-4978-891e-5e4d82838b06]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064ab89-ab10-4981-8525-877025593d51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02d604-5cf4-4293-b584-757aec84901c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61e9b4b-558e-46e0-a01e-e339454936d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c5e64e-d819-4f55-b805-438041975aa5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.069s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bce2f4c-08ae-4dca-b78a-16b6997696ff]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:46 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[759ad659-dced-49e5-9ba5-68f2740fb691]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.utils [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c12d575-5340-449a-ae05-bac26c17530f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ea3a4e-d602-415f-962c-a63887bb2675]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]
Nov 27 23:06:46 user nova-compute[75621]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.
Nov 27 23:06:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7eac91-4491-4237-a108-846b76961569]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== disconnect_volume: return (395ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:47 user nova-compute[75621]: WARNING nova.compute.manager [req-2c94ddcb-811f-45d3-8e6f-06d34cf7cb15 req-15eb7b92-ffe6-4aa7-ad69-1d54eaeb6fea service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state active and task_state rebuilding.
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:06:48 user nova-compute[75621]: INFO nova.compute.claims [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Claim successful on node user
Nov 27 23:06:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.565s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:06:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:06:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.policy [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98804fc0734a4911a2ec7cf891793b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1344bc4bacbb477fa732dd9c2b4d191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:06:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Creating image(s)
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "/opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "/opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "/opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk 1073741824" returned: 0 in 0.063s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Successfully created port: cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.215s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:06:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance destroyed successfully.
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-ServerActionsTestOtherA-server-1783046998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:04:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a4ff5fc-0b, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3428f29e-e570-44c3-8ad1-28a7e2f267ac) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:50 user nova-compute[75621]: INFO os_vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b')
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3233926-3c31-4bbb-bab1-6b18486b4941]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:06:50 user nova-compute[75621]: No targets found.
Nov 27 23:06:50 user nova-compute[75621]: iSNS:
Nov 27 23:06:50 user nova-compute[75621]: No targets found.
Nov 27 23:06:50 user nova-compute[75621]: STATIC:
Nov 27 23:06:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:06:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:06:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:06:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:06:50 user nova-compute[75621]: FIRMWARE:
Nov 27 23:06:50 user nova-compute[75621]: No targets found.
Nov 27 23:06:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:06:50 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:06:50 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[424e8125-3936-410d-b1fa-b9f1ad43b102]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Cannot resize image /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Ensure instance console log exists: /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fa87cd-b996-483c-92d7-5f7219db1520]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:50 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:06:50 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:06:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130048d120>, {}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Disconnecting from: [] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.076s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== disconnect_volume: return (77ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:06:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Deleting instance files /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b_del
Nov 27 23:06:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Deletion of /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b_del complete
Nov 27 23:06:50 user nova-compute[75621]: INFO nova.virt.block_device [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Booting with volume f542dabd-5266-46fb-a1cf-99903712ee24 at /dev/vdb
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.utils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c8bcc6-ecf3-4212-b111-49dba83d2971]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1374db58-25ba-4044-88ea-2f2d613f0045]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[019ef954-283f-446a-867c-f1ed803e84dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5be7092-e954-42f5-aad0-998a443a6fac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:06:50 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d46ec9-5740-46fe-b891-6d4f1e346ab6]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG os_brick.utils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating existing volume attachment record: 70f38336-8cee-496e-88bb-0b846929ad8b {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Successfully updated port: cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquired lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-changed-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Refreshing instance network info cache due to event network-changed-cb74aad3-272c-4fd5-afc8-f82409fe0cde. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] Acquiring lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Updating instance_info_cache with network_info: [{"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Releasing lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Instance network_info: |[{"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] Acquired lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Refreshing network info cache for port cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Start _get_guest_xml network_info=[{"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:06:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103629513',display_name='tempest-ServersNegativeTestJSON-server-1103629513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103629513',id=20,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-3vt6ke81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:49Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=f948f863-c506-4198-82e0-d04e5374a47a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lazy-loading 'pci_devices' on Instance uuid f948f863-c506-4198-82e0-d04e5374a47a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:06:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:06:51 user nova-compute[75621]:   <uuid>f948f863-c506-4198-82e0-d04e5374a47a</uuid>
Nov 27 23:06:51 user nova-compute[75621]:   <name>instance-00000014</name>
Nov 27 23:06:51 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:06:51 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:06:51 user nova-compute[75621]:   <metadata>
Nov 27 23:06:51 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:06:51 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:name>tempest-ServersNegativeTestJSON-server-1103629513</nova:name>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:06:50</nova:creationTime>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:06:51 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:06:51 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:owner>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:user uuid="98804fc0734a4911a2ec7cf891793b16">tempest-ServersNegativeTestJSON-628018506-project-member</nova:user>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:project uuid="1344bc4bacbb477fa732dd9c2b4d191a">tempest-ServersNegativeTestJSON-628018506</nova:project>
Nov 27 23:06:51 user nova-compute[75621]:       </nova:owner>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:06:51 user nova-compute[75621]:       <nova:ports>
Nov 27 23:06:51 user nova-compute[75621]:         <nova:port uuid="cb74aad3-272c-4fd5-afc8-f82409fe0cde">
Nov 27 23:06:51 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 23:06:51 user nova-compute[75621]:         </nova:port>
Nov 27 23:06:51 user nova-compute[75621]:       </nova:ports>
Nov 27 23:06:51 user nova-compute[75621]:     </nova:instance>
Nov 27 23:06:51 user nova-compute[75621]:   </metadata>
Nov 27 23:06:51 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:06:51 user nova-compute[75621]:     <system>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="serial">f948f863-c506-4198-82e0-d04e5374a47a</entry>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="uuid">f948f863-c506-4198-82e0-d04e5374a47a</entry>
Nov 27 23:06:51 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:06:51 user nova-compute[75621]:     </system>
Nov 27 23:06:51 user nova-compute[75621]:   </sysinfo>
Nov 27 23:06:51 user nova-compute[75621]:   <os>
Nov 27 23:06:51 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:06:51 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:06:51 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:06:51 user nova-compute[75621]:   </os>
Nov 27 23:06:51 user nova-compute[75621]:   <features>
Nov 27 23:06:51 user nova-compute[75621]:     <acpi/>
Nov 27 23:06:51 user nova-compute[75621]:     <apic/>
Nov 27 23:06:51 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:06:51 user nova-compute[75621]:   </features>
Nov 27 23:06:51 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:06:51 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:06:51 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:06:51 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:06:51 user nova-compute[75621]:   </clock>
Nov 27 23:06:51 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:06:51 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:06:51 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:06:51 user nova-compute[75621]:   </cpu>
Nov 27 23:06:51 user nova-compute[75621]:   <devices>
Nov 27 23:06:51 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:06:51 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:06:51 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk"/>
Nov 27 23:06:51 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:06:51 user nova-compute[75621]:     </disk>
Nov 27 23:06:51 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:06:51 user nova-compute[75621]:       <mac address="fa:16:3e:7f:5c:50"/>
Nov 27 23:06:51 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:51 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:06:51 user nova-compute[75621]:       <target dev="tapcb74aad3-27"/>
Nov 27 23:06:51 user nova-compute[75621]:     </interface>
Nov 27 23:06:51 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:06:51 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/console.log" append="off"/>
Nov 27 23:06:51 user nova-compute[75621]:     </serial>
Nov 27 23:06:51 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:06:51 user nova-compute[75621]:     <video>
Nov 27 23:06:51 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:06:51 user nova-compute[75621]:     </video>
Nov 27 23:06:51 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:06:51 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:06:51 user nova-compute[75621]:     </rng>
Nov 27 23:06:51 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:06:51 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:06:51 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:06:51 user nova-compute[75621]:     </memballoon>
Nov 27 23:06:51 user nova-compute[75621]:   </devices>
Nov 27 23:06:51 user nova-compute[75621]: </domain>
Nov 27 23:06:51 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103629513',display_name='tempest-ServersNegativeTestJSON-server-1103629513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103629513',id=20,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-3vt6ke81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:49Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=f948f863-c506-4198-82e0-d04e5374a47a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG os_vif [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b45d852-85af-55eb-bf08-4c7bc19e4867', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb74aad3-27, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcb74aad3-27, col_values=(('qos', UUID('ea8eccef-4e3c-47bf-b365-96495c172c1b')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcb74aad3-27, col_values=(('external_ids', {'iface-id': 'cb74aad3-272c-4fd5-afc8-f82409fe0cde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:5c:50', 'vm-uuid': 'f948f863-c506-4198-82e0-d04e5374a47a'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:51 user nova-compute[75621]: INFO os_vif [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27')
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] No VIF found with MAC fa:16:3e:7f:5c:50, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.network.neutron [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Updated VIF entry in instance network info cache for port cb74aad3-272c-4fd5-afc8-f82409fe0cde. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG nova.network.neutron [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Updating instance_info_cache with network_info: [{"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:06:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-097e1945-530f-43b1-8f32-b0556129e311 req-d53adaae-0f7c-4816-8f5d-26aec3eacbf7 service nova] Releasing lock "refresh_cache-f948f863-c506-4198-82e0-d04e5374a47a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] No waiting events found dispatching network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:52 user nova-compute[75621]: WARNING nova.compute.manager [req-ca0e31bf-cf59-4c1a-9207-b0307a7364eb req-7bab3736-b099-47a3-90e6-552c4ce51bdc service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received unexpected event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde for instance with vm_state building and task_state spawning.
Nov 27 23:06:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.347s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:06:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Instance spawned successfully.
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] No waiting events found dispatching network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:06:54 user nova-compute[75621]: WARNING nova.compute.manager [req-2fbf912a-4100-4715-8425-9f0664cb0e55 req-24b7961b-6939-4117-ac29-8c29c6152d83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received unexpected event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde for instance with vm_state building and task_state spawning.
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:06:54 user nova-compute[75621]: INFO nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 27 23:06:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:55 user nova-compute[75621]: INFO nova.compute.manager [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Took 6.72 seconds to build instance.
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dff062bd-f51c-46e5-8198-93d92af8c2f5 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.849s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:06:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:06:57 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:57 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:06:57 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7449MB free_disk=25.137248992919922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:06:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:06:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance a8105968-7ab2-4423-8596-36996d55397f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f948f863-c506-4198-82e0-d04e5374a47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.935s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:06:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:06:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:06:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:06:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:06:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:07:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating instance_info_cache with network_info: [{"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-171a4eaa-6326-4946-97e6-bfc6d3d3d98f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Starting finish_revert_migration {{(pid=75621) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11816}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start _get_guest_xml network_info=[{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '6c69e11d-98d4-40c1-b265-ab90112a1134', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'db2447ed-f456-41e5-b4bd-2dc243ad6c33', 'attached_at': '2023-11-27T23:07:01.000000', 'detached_at': '', 'volume_id': '4203dc00-ff03-4099-ad7d-021d6c07a20a', 'serial': '4203dc00-ff03-4099-ad7d-021d6c07a20a'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:07:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'vcpu_model' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:01 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:01 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:01 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[947470bf-a3a6-45b9-9c80-d9e6eb1c93ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:07:01 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf8229-b5a4-4cae-be78-60de4ff6d16a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a] added
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e1ea6b-55cc-4d10-a66e-6133e4c3cf03]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:07:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Creating image(s)
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6228d-8741-4e28-8ede-0b8a5a476cfd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YcTuhSKy" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd6025-0f3a-456d-bf35-6eba0becf718]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YcTuhSKy'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a6cb23-b3ca-4fbe-8275-cf564614b0f3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d8163-7ae4-48f1-87fe-d8b25610b7b6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cf4d93-65a4-4681-ad5b-d2890a03165b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:07:01 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7a7e3e-5a9b-4d2a-abe0-08c800e869f2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f97e82d-5c4f-447b-8d71-762b1aacd326]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:01 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] HCTL ('35', '-', '-', 0) found on session 21 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[649f5b0e-cf20-401a-a572-7b0dc7530ec5]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Searching for a device in session 21 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:07:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk 1073741824" returned: 0 in 0.084s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b04a6cd0-3193-4b86-8563-1d889000e76e is timed out.
Nov 27 23:07:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdb from instance b04a6cd0-3193-4b86-8563-1d889000e76e from the live domain config.
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.210s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MtoUZwnR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:02 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Cannot resize image /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Ensure instance console log exists: /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start _get_guest_xml network_info=[{"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '70f38336-8cee-496e-88bb-0b846929ad8b', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee90a2b7-403e-46ae-ab6b-a1caf604a98b', 'attached_at': '', 'detached_at': '', 'volume_id': 'f542dabd-5266-46fb-a1cf-99903712ee24', 'serial': 'f542dabd-5266-46fb-a1cf-99903712ee24'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:07:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 23:07:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:02 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431653237623032', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.586s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62b3ae-c71c-443d-8670-38211e0b2182]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:07:02 user nova-compute[75621]: No targets found.
Nov 27 23:07:02 user nova-compute[75621]: iSNS:
Nov 27 23:07:02 user nova-compute[75621]: No targets found.
Nov 27 23:07:02 user nova-compute[75621]: STATIC:
Nov 27 23:07:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:07:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:07:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:07:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:07:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:07:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:07:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2
Nov 27 23:07:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:07:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:07:02 user nova-compute[75621]: FIRMWARE:
Nov 27 23:07:02 user nova-compute[75621]: No targets found.
Nov 27 23:07:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:07:02 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:07:02 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:07:02 user nova-compute[75621]:   <uuid>db2447ed-f456-41e5-b4bd-2dc243ad6c33</uuid>
Nov 27 23:07:02 user nova-compute[75621]:   <name>instance-00000002</name>
Nov 27 23:07:02 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:07:02 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:07:02 user nova-compute[75621]:   <metadata>
Nov 27 23:07:02 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:07:02 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherB-server-774787445</nova:name>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:07:01</nova:creationTime>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:07:02 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:07:02 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:owner>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:user uuid="f116260296b94e55916e029d103f2126">tempest-ServerActionsTestOtherB-236791637-project-member</nova:user>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:project uuid="776ddd88f0e543769f6e275217231ecd">tempest-ServerActionsTestOtherB-236791637</nova:project>
Nov 27 23:07:02 user nova-compute[75621]:       </nova:owner>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:07:02 user nova-compute[75621]:       <nova:ports>
Nov 27 23:07:02 user nova-compute[75621]:         <nova:port uuid="37e89c03-0357-46ad-9765-d16725a8dca6">
Nov 27 23:07:02 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:07:02 user nova-compute[75621]:         </nova:port>
Nov 27 23:07:02 user nova-compute[75621]:       </nova:ports>
Nov 27 23:07:02 user nova-compute[75621]:     </nova:instance>
Nov 27 23:07:02 user nova-compute[75621]:   </metadata>
Nov 27 23:07:02 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:07:02 user nova-compute[75621]:     <system>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="serial">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="uuid">db2447ed-f456-41e5-b4bd-2dc243ad6c33</entry>
Nov 27 23:07:02 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:07:02 user nova-compute[75621]:     </system>
Nov 27 23:07:02 user nova-compute[75621]:   </sysinfo>
Nov 27 23:07:02 user nova-compute[75621]:   <os>
Nov 27 23:07:02 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:07:02 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:07:02 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:07:02 user nova-compute[75621]:   </os>
Nov 27 23:07:02 user nova-compute[75621]:   <features>
Nov 27 23:07:02 user nova-compute[75621]:     <acpi/>
Nov 27 23:07:02 user nova-compute[75621]:     <apic/>
Nov 27 23:07:02 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:07:02 user nova-compute[75621]:   </features>
Nov 27 23:07:02 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:07:02 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:07:02 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:07:02 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:07:02 user nova-compute[75621]:   </clock>
Nov 27 23:07:02 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:07:02 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:07:02 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:07:02 user nova-compute[75621]:   </cpu>
Nov 27 23:07:02 user nova-compute[75621]:   <devices>
Nov 27 23:07:02 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:07:02 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:07:02 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk"/>
Nov 27 23:07:02 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:07:02 user nova-compute[75621]:     </disk>
Nov 27 23:07:02 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:07:02 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:07:02 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:07:02 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:07:02 user nova-compute[75621]:       <serial>4203dc00-ff03-4099-ad7d-021d6c07a20a</serial>
Nov 27 23:07:02 user nova-compute[75621]:     </disk>
Nov 27 23:07:02 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:07:02 user nova-compute[75621]:       <mac address="fa:16:3e:c7:38:3e"/>
Nov 27 23:07:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:02 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:07:02 user nova-compute[75621]:       <target dev="tap37e89c03-03"/>
Nov 27 23:07:02 user nova-compute[75621]:     </interface>
Nov 27 23:07:02 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:07:02 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/console.log" append="off"/>
Nov 27 23:07:02 user nova-compute[75621]:     </serial>
Nov 27 23:07:02 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:07:02 user nova-compute[75621]:     <video>
Nov 27 23:07:02 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:02 user nova-compute[75621]:     </video>
Nov 27 23:07:02 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:07:02 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:07:02 user nova-compute[75621]:     </rng>
Nov 27 23:07:02 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:07:02 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:07:02 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:07:02 user nova-compute[75621]:     </memballoon>
Nov 27 23:07:02 user nova-compute[75621]:   </devices>
Nov 27 23:07:02 user nova-compute[75621]: </domain>
Nov 27 23:07:02 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:06:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8c9edd9e-acf0-5757-a6e0-90235a8d6978', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bb224c-6d20-4bc1-a7ec-cfe4eacbfc63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e89c03-03, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37e89c03-03, col_values=(('qos', UUID('d3ed43a2-4783-4597-85f4-5c96456ed840')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37e89c03-03, col_values=(('external_ids', {'iface-id': '37e89c03-0357-46ad-9765-d16725a8dca6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:38:3e', 'vm-uuid': 'db2447ed-f456-41e5-b4bd-2dc243ad6c33'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:02 user nova-compute[75621]: INFO os_vif [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9278902c-3be3-474b-bd5b-af5cedf6688c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:02 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:02 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:02 user nova-compute[75621]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 (non-flash)
Nov 27 23:07:02 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1300747eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3978b7-14fe-4d25-aa80-9f896c294f31]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b59c3c-ad2c-485a-914c-212b647a17c1]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b4680-39da-4041-9994-abeee8259fce]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31187a45-22ab-4bf3-b101-ac2ecd8a053b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:07:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[951d9886-30ee-4e59-a12c-6718759362fc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[441f4eb2-55b7-4aae-aa69-a6e6e99754e3]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260]
Nov 27 23:07:03 user nova-compute[75621]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2, portal: 172.16.0.220,3260] successful.
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50bfd854-7ced-465f-9682-753bb197abe2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.128s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6006f143-1ac6-478d-b3b3-faf31ab134ea]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== disconnect_volume: return (1008ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.667s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:03 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:03 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a790662-c1b1-4025-88a4-72edb853b410]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:07:03 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afb363b-4e32-49f2-a99c-3709e64237aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24] added
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44393d-fcb2-4a0c-8f52-7f876f323883]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6239c73d-22ac-4063-8a4f-c9240e682dc3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsIZgaC {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iTsIZgaC" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a26ee-0fa3-4396-9608-d9b3e10e9001]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iTsIZgaC'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d58c7-bee7-450e-a179-5717a8e533e7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[678eb13c-5a8a-44e3-904b-43ac9a256ef1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e7ba10-83a7-4115-be25-648147e8f07a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]
Nov 27 23:07:03 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d861bf72-7c36-4055-a05e-d6a7a99778fa]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f019d072-7cae-447e-976c-1ff299132f4b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9d0d18-a858-4411-ac9b-8ea09c45e71c]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.objects.instance [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da297639-1ed7-43f1-8038-8e026f6e599e tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.945s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== connect_volume: return (1998ms) {'type': 'block', 'scsi_wwn': '23731643837316232', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731643837316232', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:04 user nova-compute[75621]: WARNING nova.compute.manager [req-23830c46-28e3-4743-9483-aaf6e8d7b189 req-45621c71-c3b0-4209-9aae-66eb0d61215f service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-ServerActionsTestOtherA-server-1783046998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:04:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:07:04 user nova-compute[75621]:   <uuid>ee90a2b7-403e-46ae-ab6b-a1caf604a98b</uuid>
Nov 27 23:07:04 user nova-compute[75621]:   <name>instance-0000000f</name>
Nov 27 23:07:04 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:07:04 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:07:04 user nova-compute[75621]:   <metadata>
Nov 27 23:07:04 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:07:04 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherA-server-1783046998</nova:name>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:07:02</nova:creationTime>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:07:04 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:07:04 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:owner>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:user uuid="d4cbbd5877014527889b23cd592da5f0">tempest-ServerActionsTestOtherA-1166847266-project-member</nova:user>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:project uuid="7af3c98f53504bd39917790819b9bae6">tempest-ServerActionsTestOtherA-1166847266</nova:project>
Nov 27 23:07:04 user nova-compute[75621]:       </nova:owner>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:07:04 user nova-compute[75621]:       <nova:ports>
Nov 27 23:07:04 user nova-compute[75621]:         <nova:port uuid="4a4ff5fc-0b77-4dba-b146-0ae201275cb9">
Nov 27 23:07:04 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:07:04 user nova-compute[75621]:         </nova:port>
Nov 27 23:07:04 user nova-compute[75621]:       </nova:ports>
Nov 27 23:07:04 user nova-compute[75621]:     </nova:instance>
Nov 27 23:07:04 user nova-compute[75621]:   </metadata>
Nov 27 23:07:04 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:07:04 user nova-compute[75621]:     <system>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="serial">ee90a2b7-403e-46ae-ab6b-a1caf604a98b</entry>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="uuid">ee90a2b7-403e-46ae-ab6b-a1caf604a98b</entry>
Nov 27 23:07:04 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:07:04 user nova-compute[75621]:     </system>
Nov 27 23:07:04 user nova-compute[75621]:   </sysinfo>
Nov 27 23:07:04 user nova-compute[75621]:   <os>
Nov 27 23:07:04 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:07:04 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:07:04 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:07:04 user nova-compute[75621]:   </os>
Nov 27 23:07:04 user nova-compute[75621]:   <features>
Nov 27 23:07:04 user nova-compute[75621]:     <acpi/>
Nov 27 23:07:04 user nova-compute[75621]:     <apic/>
Nov 27 23:07:04 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:07:04 user nova-compute[75621]:   </features>
Nov 27 23:07:04 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:07:04 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:07:04 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:07:04 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:07:04 user nova-compute[75621]:   </clock>
Nov 27 23:07:04 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:07:04 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:07:04 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:07:04 user nova-compute[75621]:   </cpu>
Nov 27 23:07:04 user nova-compute[75621]:   <devices>
Nov 27 23:07:04 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:07:04 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:07:04 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk"/>
Nov 27 23:07:04 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:07:04 user nova-compute[75621]:     </disk>
Nov 27 23:07:04 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:07:04 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:07:04 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:07:04 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:07:04 user nova-compute[75621]:       <serial>f542dabd-5266-46fb-a1cf-99903712ee24</serial>
Nov 27 23:07:04 user nova-compute[75621]:     </disk>
Nov 27 23:07:04 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:07:04 user nova-compute[75621]:       <mac address="fa:16:3e:c3:51:c7"/>
Nov 27 23:07:04 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:04 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:07:04 user nova-compute[75621]:       <target dev="tap4a4ff5fc-0b"/>
Nov 27 23:07:04 user nova-compute[75621]:     </interface>
Nov 27 23:07:04 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:07:04 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/console.log" append="off"/>
Nov 27 23:07:04 user nova-compute[75621]:     </serial>
Nov 27 23:07:04 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:07:04 user nova-compute[75621]:     <video>
Nov 27 23:07:04 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:04 user nova-compute[75621]:     </video>
Nov 27 23:07:04 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:07:04 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:07:04 user nova-compute[75621]:     </rng>
Nov 27 23:07:04 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:07:04 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:07:04 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:07:04 user nova-compute[75621]:     </memballoon>
Nov 27 23:07:04 user nova-compute[75621]:   </devices>
Nov 27 23:07:04 user nova-compute[75621]: </domain>
Nov 27 23:07:04 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-ServerActionsTestOtherA-server-1783046998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:04:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:06:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG os_vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9863052d-4cdd-5358-b321-ff2ce0315814', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a4ff5fc-0b, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a4ff5fc-0b, col_values=(('qos', UUID('75dbea1b-ed34-42ae-b81e-ca01bd672948')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a4ff5fc-0b, col_values=(('external_ids', {'iface-id': '4a4ff5fc-0b77-4dba-b146-0ae201275cb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:51:c7', 'vm-uuid': 'ee90a2b7-403e-46ae-ab6b-a1caf604a98b'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:04 user nova-compute[75621]: INFO os_vif [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b')
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:c3:51:c7, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75621) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG nova.objects.instance [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance destroyed successfully.
Nov 27 23:07:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-584c4efe-f734-4edb-9c0e-cee4f13e95a9 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.336s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:06 user nova-compute[75621]: WARNING nova.compute.manager [req-50cdb50c-c9e3-4e0e-bdbf-a9c0d46eb512 req-59bd9bf2-2ac2-42a3-9274-a501f0af8bba service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state resized and task_state resize_reverting.
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:07 user nova-compute[75621]: INFO nova.compute.manager [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Terminating instance
Nov 27 23:07:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:08 user nova-compute[75621]: WARNING nova.compute.manager [req-a7c4267a-5db0-4609-b7fa-8298f3111b4e req-dc6784e5-2eac-4ac1-9cbe-0c4683e5982b service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state None.
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:07:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance running successfully.
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] finish_revert_migration finished successfully. {{(pid=75621) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11860}}
Nov 27 23:07:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Instance destroyed successfully.
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lazy-loading 'resources' on Instance uuid 171a4eaa-6326-4946-97e6-bfc6d3d3d98f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:01:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-806269045',display_name='tempest-VolumesAdminNegativeTest-server-806269045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-806269045',id=7,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAidA3AGVE2W4HiizbpHqUGV3wmdb1VMUVOPxGEUFX/YnIlcfd6KVLOG5FTgDv+kQGEfUTOcap6e5HzEyAunkRjHuUR+gM6pxpoWabYQIisfdzLIokO26x0y8JLe2egcHg==',key_name='tempest-keypair-699797478',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6d33d270e0a49cba0e556853f679e5f',ramdisk_id='',reservation_id='r-lh89suvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-660006676',owner_user_name='tempest-VolumesAdminNegativeTest-660006676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='84427eb8d68248c0ba849904dc3cbb27',uuid=171a4eaa-6326-4946-97e6-bfc6d3d3d98f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converting VIF {"id": "d340b0c4-29e1-4243-a87b-92171c11212e", "address": "fa:16:3e:1e:bc:3e", "network": {"id": "a6fd2468-20ff-4566-885f-2edb80a70dd8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-857050707-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6d33d270e0a49cba0e556853f679e5f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd340b0c4-29", "ovs_interfaceid": "d340b0c4-29e1-4243-a87b-92171c11212e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG os_vif [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd340b0c4-29, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dad1cd31-b2ed-4c9a-90b3-0da80634f0e3) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:08 user nova-compute[75621]: INFO os_vif [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:bc:3e,bridge_name='br-int',has_traffic_filtering=True,id=d340b0c4-29e1-4243-a87b-92171c11212e,network=Network(a6fd2468-20ff-4566-885f-2edb80a70dd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd340b0c4-29')
Nov 27 23:07:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Deleting instance files /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f_del
Nov 27 23:07:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Deletion of /opt/stack/data/nova/instances/171a4eaa-6326-4946-97e6-bfc6d3d3d98f_del complete
Nov 27 23:07:09 user nova-compute[75621]: INFO nova.compute.manager [None req-afd0c396-5d36-435a-a45e-ee35fa401cf3 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance to original state: 'active'
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:09 user nova-compute[75621]: WARNING nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:09 user nova-compute[75621]: WARNING nova.compute.manager [req-78acb454-ce29-45d0-8ba2-0404abd81cb9 req-568fbfd2-6293-41c3-83ca-158f062dcb79 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-unplugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] No waiting events found dispatching network-vif-unplugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-64e4a948-1068-4a73-91b4-746e86a5fa5a req-9d721bca-ad45-4630-b60f-8f2eafe5ebd4 service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-unplugged-d340b0c4-29e1-4243-a87b-92171c11212e for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:07:09 user nova-compute[75621]: INFO nova.compute.manager [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:07:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance spawned successfully.
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG nova.objects.instance [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75621) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 27 23:07:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-484fe5fd-e535-4393-8fbb-e73ae43b23d0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:10 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Took 1.30 seconds to deallocate network for instance.
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:10 user nova-compute[75621]: WARNING nova.compute.manager [req-98649ebf-ce16-42a0-8347-b0a2c5b72cb2 req-0442ea55-45f1-4c61-85a3-866d2176f279 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state None.
Nov 27 23:07:10 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:07:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:11 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Deleted allocations for instance 171a4eaa-6326-4946-97e6-bfc6d3d3d98f
Nov 27 23:07:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] Acquiring lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] No waiting events found dispatching network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:11 user nova-compute[75621]: WARNING nova.compute.manager [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received unexpected event network-vif-plugged-d340b0c4-29e1-4243-a87b-92171c11212e for instance with vm_state deleted and task_state None.
Nov 27 23:07:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-4cde991d-6a8b-41ad-b444-27b2a0a1c635 req-c3f65514-2dff-4603-9168-b4e9ec4e762d service nova] [instance: 171a4eaa-6326-4946-97e6-bfc6d3d3d98f] Received event network-vif-deleted-d340b0c4-29e1-4243-a87b-92171c11212e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c6d4378-9f77-47a2-8ca9-7ea25a245ce0 tempest-VolumesAdminNegativeTest-660006676 tempest-VolumesAdminNegativeTest-660006676-project-member] Lock "171a4eaa-6326-4946-97e6-bfc6d3d3d98f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.245s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:15 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:07:15 user nova-compute[75621]: INFO nova.compute.claims [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Claim successful on node user
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.519s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:07:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.policy [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13a84f0a4b3a43b4a68efc24f8d561e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec921f4d672434cb443a0260fa2eef8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:07:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Creating image(s)
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "/opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "/opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "/opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk 1073741824" returned: 0 in 0.059s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.247s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Successfully created port: 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Cannot resize image /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Ensure instance console log exists: /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Successfully updated port: 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquired lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-changed-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Refreshing instance network info cache due to event network-changed-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] Acquiring lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Releasing lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Instance network_info: |[{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] Acquired lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Refreshing network info cache for port 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Start _get_guest_xml network_info=[{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:07:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1456105911',display_name='tempest-SnapshotDataIntegrityTests-server-1456105911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1456105911',id=21,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LiXvXuUzqsfs+X3sQ8+0VsKAAr4eL4d1dciMyKUdoHvEjY0qyBMeIsFuLSmbNYVDNgMduXNlLpD3fBy2hJD7bGazJNj/SF2+jz15D1zNznB2y2zRgDRPqvxpVPnDGCA==',key_name='tempest-keypair-196173175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ec921f4d672434cb443a0260fa2eef8',ramdisk_id='',reservation_id='r-6j8nan63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-863184707',owner_user_name='tempest-SnapshotDataIntegrityTests-863184707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a84f0a4b3a43b4a68efc24f8d561e7',uuid=b637ed1f-2fc0-4484-b721-850dca879491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converting VIF {"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'pci_devices' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:07:18 user nova-compute[75621]:   <uuid>b637ed1f-2fc0-4484-b721-850dca879491</uuid>
Nov 27 23:07:18 user nova-compute[75621]:   <name>instance-00000015</name>
Nov 27 23:07:18 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:07:18 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:07:18 user nova-compute[75621]:   <metadata>
Nov 27 23:07:18 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:07:18 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1456105911</nova:name>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:07:18</nova:creationTime>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:07:18 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:07:18 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:owner>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:user uuid="13a84f0a4b3a43b4a68efc24f8d561e7">tempest-SnapshotDataIntegrityTests-863184707-project-member</nova:user>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:project uuid="9ec921f4d672434cb443a0260fa2eef8">tempest-SnapshotDataIntegrityTests-863184707</nova:project>
Nov 27 23:07:18 user nova-compute[75621]:       </nova:owner>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:07:18 user nova-compute[75621]:       <nova:ports>
Nov 27 23:07:18 user nova-compute[75621]:         <nova:port uuid="45ef4e4b-57a2-45dd-97d4-a9d41fcf159c">
Nov 27 23:07:18 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:07:18 user nova-compute[75621]:         </nova:port>
Nov 27 23:07:18 user nova-compute[75621]:       </nova:ports>
Nov 27 23:07:18 user nova-compute[75621]:     </nova:instance>
Nov 27 23:07:18 user nova-compute[75621]:   </metadata>
Nov 27 23:07:18 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:07:18 user nova-compute[75621]:     <system>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="serial">b637ed1f-2fc0-4484-b721-850dca879491</entry>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="uuid">b637ed1f-2fc0-4484-b721-850dca879491</entry>
Nov 27 23:07:18 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:07:18 user nova-compute[75621]:     </system>
Nov 27 23:07:18 user nova-compute[75621]:   </sysinfo>
Nov 27 23:07:18 user nova-compute[75621]:   <os>
Nov 27 23:07:18 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:07:18 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:07:18 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:07:18 user nova-compute[75621]:   </os>
Nov 27 23:07:18 user nova-compute[75621]:   <features>
Nov 27 23:07:18 user nova-compute[75621]:     <acpi/>
Nov 27 23:07:18 user nova-compute[75621]:     <apic/>
Nov 27 23:07:18 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:07:18 user nova-compute[75621]:   </features>
Nov 27 23:07:18 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:07:18 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:07:18 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:07:18 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:07:18 user nova-compute[75621]:   </clock>
Nov 27 23:07:18 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:07:18 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:07:18 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:07:18 user nova-compute[75621]:   </cpu>
Nov 27 23:07:18 user nova-compute[75621]:   <devices>
Nov 27 23:07:18 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:07:18 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:07:18 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk"/>
Nov 27 23:07:18 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:07:18 user nova-compute[75621]:     </disk>
Nov 27 23:07:18 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:07:18 user nova-compute[75621]:       <mac address="fa:16:3e:59:85:77"/>
Nov 27 23:07:18 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:18 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:07:18 user nova-compute[75621]:       <target dev="tap45ef4e4b-57"/>
Nov 27 23:07:18 user nova-compute[75621]:     </interface>
Nov 27 23:07:18 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:07:18 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/console.log" append="off"/>
Nov 27 23:07:18 user nova-compute[75621]:     </serial>
Nov 27 23:07:18 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:07:18 user nova-compute[75621]:     <video>
Nov 27 23:07:18 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:18 user nova-compute[75621]:     </video>
Nov 27 23:07:18 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:07:18 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:07:18 user nova-compute[75621]:     </rng>
Nov 27 23:07:18 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:07:18 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:07:18 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:07:18 user nova-compute[75621]:     </memballoon>
Nov 27 23:07:18 user nova-compute[75621]:   </devices>
Nov 27 23:07:18 user nova-compute[75621]: </domain>
Nov 27 23:07:18 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1456105911',display_name='tempest-SnapshotDataIntegrityTests-server-1456105911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1456105911',id=21,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LiXvXuUzqsfs+X3sQ8+0VsKAAr4eL4d1dciMyKUdoHvEjY0qyBMeIsFuLSmbNYVDNgMduXNlLpD3fBy2hJD7bGazJNj/SF2+jz15D1zNznB2y2zRgDRPqvxpVPnDGCA==',key_name='tempest-keypair-196173175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ec921f4d672434cb443a0260fa2eef8',ramdisk_id='',reservation_id='r-6j8nan63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-863184707',owner_user_name='tempest-SnapshotDataIntegrityTests-863184707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a84f0a4b3a43b4a68efc24f8d561e7',uuid=b637ed1f-2fc0-4484-b721-850dca879491,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converting VIF {"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG os_vif [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2b036ba-b7e4-5cd7-b6d6-ff8bd8fc6ebb', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45ef4e4b-57, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45ef4e4b-57, col_values=(('qos', UUID('c26ccc01-258f-4e6a-b495-4f4ac8b570fa')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45ef4e4b-57, col_values=(('external_ids', {'iface-id': '45ef4e4b-57a2-45dd-97d4-a9d41fcf159c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:85:77', 'vm-uuid': 'b637ed1f-2fc0-4484-b721-850dca879491'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:18 user nova-compute[75621]: INFO os_vif [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57')
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No VIF found with MAC fa:16:3e:59:85:77, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updated VIF entry in instance network info cache for port 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-eba5390e-c406-4cc7-bfa0-90699b34deb7 req-9852f305-4f01-497b-b3c2-fca3793058ff service nova] Releasing lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] No waiting events found dispatching network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:20 user nova-compute[75621]: WARNING nova.compute.manager [req-34992a1e-0bf1-4bae-a1b0-a9db45caaeba req-ba6f804a-e0d5-4a8e-b041-1f6593ff17f0 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received unexpected event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c for instance with vm_state building and task_state spawning.
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:07:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Instance spawned successfully.
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] No waiting events found dispatching network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:22 user nova-compute[75621]: WARNING nova.compute.manager [req-d55a7ccb-0678-453b-99ef-21a8f8a0bdd8 req-dac05347-5f9d-4d6f-a69c-e02cb74671fd service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received unexpected event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c for instance with vm_state building and task_state spawning.
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:22 user nova-compute[75621]: INFO nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Took 6.22 seconds to spawn the instance on the hypervisor.
Nov 27 23:07:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:22 user nova-compute[75621]: INFO nova.compute.manager [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Took 7.10 seconds to build instance.
Nov 27 23:07:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d2d49938-a8f7-4797-9b4d-f14e35a3ac43 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.211s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid f13a1f06-0c06-46df-b958-bfc33d6272fa {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 6573b4cf-062d-4beb-b387-1f0966fd1ae8 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid d0ad520b-a961-42cd-bb7e-67329a158e5d {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid f948f863-c506-4198-82e0-d04e5374a47a {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b75ec495-38b4-42ff-a489-13b76129b094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f948f863-c506-4198-82e0-d04e5374a47a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b75ec495-38b4-42ff-a489-13b76129b094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f948f863-c506-4198-82e0-d04e5374a47a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:37 user nova-compute[75621]: INFO nova.compute.manager [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Unrescuing
Nov 27 23:07:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'flavor' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:38 user nova-compute[75621]: WARNING nova.compute.manager [req-ef22c762-d570-44c5-9dfa-6d2a0633eb21 req-eeea1d9c-2967-43fd-853b-738da7472c99 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:07:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance destroyed successfully.
Nov 27 23:07:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:40 user nova-compute[75621]: WARNING nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:40 user nova-compute[75621]: WARNING nova.compute.manager [req-447de635-36b3-41f4-8e27-0b097b2fe5ce req-b1a7416d-db0b-4ba1-b7ba-b88287542b30 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:07:40 user nova-compute[75621]: INFO nova.compute.claims [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Claim successful on node user
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:07:40 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:07:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.policy [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5427c1c08da34bfead47d98f813db775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37829e68e182457e8df131abcebd5606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:07:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Creating image(s)
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk 1073741824" returned: 0 in 0.052s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-872775f7-ab4c-4a25-b4d9-dc3d247dcdea tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Cannot resize image /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Ensure instance console log exists: /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Successfully created port: ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:42 user nova-compute[75621]: WARNING nova.compute.manager [req-468b57ef-b45e-42e6-9b1d-d968c8ea01cd req-894a84cb-a95d-41e7-865f-292abfcb65ef service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state active and task_state None.
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Successfully updated port: ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance network_info: |[{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start _get_guest_xml network_info=[{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:07:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:07:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjFmWjrV/uV4RjnK4/QTWN3j4patv1h4FdIT8+U3PAhRRGxNdu9C6Ov1gP/640O+qsHILAi5acywQgBhIywJQtZJLfkhQH/aThAmLWzZEy45f+Tgc0FjzZKXiak5IepuQ==',key_name='tempest-keypair-131461733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_devices' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:07:43 user nova-compute[75621]:   <uuid>993ba2a7-2dc0-46f2-8fff-45395e01e340</uuid>
Nov 27 23:07:43 user nova-compute[75621]:   <name>instance-00000016</name>
Nov 27 23:07:43 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:07:43 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:07:43 user nova-compute[75621]:   <metadata>
Nov 27 23:07:43 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:07:43 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1967555061</nova:name>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:07:42</nova:creationTime>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:07:43 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:07:43 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:owner>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:user uuid="5427c1c08da34bfead47d98f813db775">tempest-AttachVolumeShelveTestJSON-355781585-project-member</nova:user>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:project uuid="37829e68e182457e8df131abcebd5606">tempest-AttachVolumeShelveTestJSON-355781585</nova:project>
Nov 27 23:07:43 user nova-compute[75621]:       </nova:owner>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:07:43 user nova-compute[75621]:       <nova:ports>
Nov 27 23:07:43 user nova-compute[75621]:         <nova:port uuid="ad192969-9c6d-4db8-b6cb-02f7ca696616">
Nov 27 23:07:43 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 23:07:43 user nova-compute[75621]:         </nova:port>
Nov 27 23:07:43 user nova-compute[75621]:       </nova:ports>
Nov 27 23:07:43 user nova-compute[75621]:     </nova:instance>
Nov 27 23:07:43 user nova-compute[75621]:   </metadata>
Nov 27 23:07:43 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:07:43 user nova-compute[75621]:     <system>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="serial">993ba2a7-2dc0-46f2-8fff-45395e01e340</entry>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="uuid">993ba2a7-2dc0-46f2-8fff-45395e01e340</entry>
Nov 27 23:07:43 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:07:43 user nova-compute[75621]:     </system>
Nov 27 23:07:43 user nova-compute[75621]:   </sysinfo>
Nov 27 23:07:43 user nova-compute[75621]:   <os>
Nov 27 23:07:43 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:07:43 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:07:43 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:07:43 user nova-compute[75621]:   </os>
Nov 27 23:07:43 user nova-compute[75621]:   <features>
Nov 27 23:07:43 user nova-compute[75621]:     <acpi/>
Nov 27 23:07:43 user nova-compute[75621]:     <apic/>
Nov 27 23:07:43 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:07:43 user nova-compute[75621]:   </features>
Nov 27 23:07:43 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:07:43 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:07:43 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:07:43 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:07:43 user nova-compute[75621]:   </clock>
Nov 27 23:07:43 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:07:43 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:07:43 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:07:43 user nova-compute[75621]:   </cpu>
Nov 27 23:07:43 user nova-compute[75621]:   <devices>
Nov 27 23:07:43 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:07:43 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:07:43 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk"/>
Nov 27 23:07:43 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:07:43 user nova-compute[75621]:     </disk>
Nov 27 23:07:43 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:07:43 user nova-compute[75621]:       <mac address="fa:16:3e:51:7f:cd"/>
Nov 27 23:07:43 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:43 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:07:43 user nova-compute[75621]:       <target dev="tapad192969-9c"/>
Nov 27 23:07:43 user nova-compute[75621]:     </interface>
Nov 27 23:07:43 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:07:43 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/console.log" append="off"/>
Nov 27 23:07:43 user nova-compute[75621]:     </serial>
Nov 27 23:07:43 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:07:43 user nova-compute[75621]:     <video>
Nov 27 23:07:43 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:07:43 user nova-compute[75621]:     </video>
Nov 27 23:07:43 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:07:43 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:07:43 user nova-compute[75621]:     </rng>
Nov 27 23:07:43 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:07:43 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:07:43 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:07:43 user nova-compute[75621]:     </memballoon>
Nov 27 23:07:43 user nova-compute[75621]:   </devices>
Nov 27 23:07:43 user nova-compute[75621]: </domain>
Nov 27 23:07:43 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjFmWjrV/uV4RjnK4/QTWN3j4patv1h4FdIT8+U3PAhRRGxNdu9C6Ov1gP/640O+qsHILAi5acywQgBhIywJQtZJLfkhQH/aThAmLWzZEy45f+Tgc0FjzZKXiak5IepuQ==',key_name='tempest-keypair-131461733',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG os_vif [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf040b39-bdad-5934-8261-f7e285cafb03', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad192969-9c, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad192969-9c, col_values=(('qos', UUID('e3c40954-6075-474e-889e-5cfded3c7ea9')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad192969-9c, col_values=(('external_ids', {'iface-id': 'ad192969-9c6d-4db8-b6cb-02f7ca696616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:7f:cd', 'vm-uuid': '993ba2a7-2dc0-46f2-8fff-45395e01e340'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:43 user nova-compute[75621]: INFO os_vif [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c')
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No VIF found with MAC fa:16:3e:51:7f:cd, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:07:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing instance network info cache due to event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updated VIF entry in instance network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8174961d-3e2e-4abc-bbd0-2245e57fab70 req-e0a6a946-f89d-4780-94cd-41181ff1c42a service nova] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.compute.manager [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:44 user nova-compute[75621]: WARNING nova.compute.manager [req-b79b67e3-09c8-4469-94ef-8373888ab314 req-293ac23c-a129-4dcf-a793-73322983c1cd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state building and task_state spawning.
Nov 27 23:07:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG nova.objects.instance [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lazy-loading 'flavor' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:45 user nova-compute[75621]: INFO nova.compute.manager [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attaching volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 to /dev/vdb
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.utils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ccf8be-841a-47f6-ba5a-6b851c0cd33f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bfe80c-8cbe-4d29-bbd9-e2ec18941759]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a3398-2350-4516-a3a5-7d5c7cdc304b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad3336d-f9c0-4a50-90eb-8e00b17fd706]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:07:45 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:07:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef122a55-9684-44dc-84e1-dc1fef3fad34]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG os_brick.utils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:45 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updating existing volume attachment record: 0f4b1aa3-e4e9-42c3-85ae-f73e605eeaf6 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:07:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance spawned successfully.
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:07:46 user nova-compute[75621]: INFO nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-changed-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Refreshing instance network info cache due to event network-changed-7ac5733a-2058-40e6-9da9-33e12a0c9ac8. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Acquiring lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Acquired lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Refreshing network info cache for port 7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:07:46 user nova-compute[75621]: INFO nova.compute.manager [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Took 6.35 seconds to build instance.
Nov 27 23:07:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c83b2cd6-22f6-48f5-a279-e4845ddea865 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.455s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updated VIF entry in instance network info cache for port 7ac5733a-2058-40e6-9da9-33e12a0c9ac8. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updating instance_info_cache with network_info: [{"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Releasing lock "refresh_cache-a8105968-7ab2-4423-8596-36996d55397f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:07:47 user nova-compute[75621]: WARNING nova.compute.manager [req-cd0eccde-87a9-4337-b3cc-40d42435ec3c req-59adc29e-ce76-4bf6-ba0e-0a278d90ac60 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state building and task_state spawning.
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-changed-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing instance network info cache due to event network-changed-41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updated VIF entry in instance network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a77aa3a-a557-4f3f-bc4d-0a5e6ea45440 req-48c788f0-0990-4fcb-8a74-b089f250b1b8 service nova] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:50 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:51 user nova-compute[75621]: INFO nova.compute.manager [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] instance snapshotting
Nov 27 23:07:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Beginning live snapshot process
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json -f qcow2" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68.delta 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68.delta 1073741824" returned: 0 in 0.049s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:07:52 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e0258a-c95b-4a18-b4cc-11aab7908ceb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:07:52 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a64198e-1f01-47fe-889e-967ba6946a8f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5] added
Nov 27 23:07:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c202d1-5fdf-4823-a9ad-9528d5364e54]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0254d3b6-2517-475c-bcba-40edc0580870]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krqElGfD {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krqElGfD" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b333858c-eb8b-40bb-849a-9ae9e9e4309b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'krqElGfD'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f77c06-ffb8-412f-bde3-3a06c799da1d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6ba1d-4ea7-4050-9162-a823e407de81]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf95471e-7b09-44c6-9f19-7bcc30980eb8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]
Nov 27 23:07:53 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:07:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c262e4-5d6c-4d29-84c3-885ea3f56c54]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ffc45d-4ca7-41b3-9950-f3d177a8d0aa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:07:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f3467d-58ea-41aa-ab6c-8ec50042a7a7]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:07:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 23:07:53 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:07:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68.delta /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68.delta /opt/stack/data/nova/instances/snapshots/tmp21p4f_tk/4745acd1bf1f4063a5253a282598fb68" returned: 0 in 0.244s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Snapshot extracted, beginning image upload
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23634383735666661', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634383735666661', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lazy-loading 'flavor' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:07:54 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:07:54 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:07:54 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:07:54 user nova-compute[75621]:   <serial>59dd246e-cb3c-44a8-8ba2-ce7d6db936c5</serial>
Nov 27 23:07:54 user nova-compute[75621]: </disk>
Nov 27 23:07:54 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] No VIF found with MAC fa:16:3e:3f:6d:3f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-950e65c0-bfe7-45f7-a153-586ec14722cf tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.458s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG os_brick.utils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[730faca3-45b2-4fbf-921f-caa6ee20ca77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad454c5-6981-49c8-9717-d7116fdd29c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1102f68f-66c9-4d55-bfe3-440d28e051f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[65adb214-c40e-4adf-be4f-d7fe2f39fcdf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:07:56 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58c4012-1fc6-4434-bce7-45c06b6de468]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG os_brick.utils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:07:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.077640533447266GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:07:56 user nova-compute[75621]: INFO nova.compute.manager [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Swapping volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 for ac3c66c1-2b71-42cf-a326-26b9636b3e69
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance a8105968-7ab2-4423-8596-36996d55397f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f948f863-c506-4198-82e0-d04e5374a47a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:07:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:07:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Snapshot image upload complete
Nov 27 23:07:56 user nova-compute[75621]: INFO nova.compute.manager [None req-9cb283ce-c2ea-41e6-93a2-cf5d8f23aa05 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Took 5.05 seconds to snapshot the instance on the hypervisor.
Nov 27 23:07:57 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:07:57 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:07:57 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:07:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.590s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:07:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:07:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:08:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:08:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'serial': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'serial'} {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:03 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:03 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:03 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:08:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d519e-90a4-4c19-9f57-4f443b20b30f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:08:03 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc75958-6e15-43fc-8951-8589e02c5917]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69] added
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7250b2b4-b118-45b8-a8d6-f79a5ecc54a3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1907ea20-1a33-41a1-b50d-a43079bac15a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYcPQBtT {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fYcPQBtT" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce51f8a-8e84-4a23-99c2-551da17fa8ba]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fYcPQBtT'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c0e058-b632-46a6-811b-f83abdb0a663]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402288d-e7e5-45d6-85e2-0c3d3a5791fd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cdba81-c42b-4d15-befb-8fee1d58ab88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260]
Nov 27 23:08:03 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbbc212-09cf-4f74-bebb-ef93158b20b5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c151393-585f-40dc-9d28-5e15696b1995]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:03 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62634f01-14ee-45fe-91b6-fcf778f29400]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:08:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:08:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26466653763623832', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466653763623832', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:08:04 user nova-compute[75621]: DEBUG nova.objects.instance [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lazy-loading 'flavor' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 6291456 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 173015040 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 322961408 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 683671552 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 859832320 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 1035993088 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:08 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:08 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9d3e79-92c4-424a-9e3d-cde05f3b9092]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:08:09 user nova-compute[75621]: No targets found.
Nov 27 23:08:09 user nova-compute[75621]: iSNS:
Nov 27 23:08:09 user nova-compute[75621]: No targets found.
Nov 27 23:08:09 user nova-compute[75621]: STATIC:
Nov 27 23:08:09 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:08:09 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:09 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:09 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:09 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:09 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:09 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:08:09 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:09 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:09 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69
Nov 27 23:08:09 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:09 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:09 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:08:09 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:09 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:09 user nova-compute[75621]: FIRMWARE:
Nov 27 23:08:09 user nova-compute[75621]: No targets found.
Nov 27 23:08:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:08:09 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:08:09 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0277bbaa-3f46-4356-8a44-125fbaeaeb6a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0551c53-5104-4047-97b2-ff65797bc055]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e068dfc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf94e6f3-fa17-46d3-ab22-2a75ef90a398]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852ce19-ef44-40d5-bb91-8fdfed6c6a2a]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3242d4-e3da-4bda-aa72-a230220f043d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae68a580-bcb3-4431-873e-131bb5a23a1b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f3e480-2d83-4613-aa13-3a6c42791b91]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e999dc26-3f3e-4a7d-9fae-b4236615b757]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]
Nov 27 23:08:09 user nova-compute[75621]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[995299ca-78ae-4132-b739-bf9f6fac9d58]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== disconnect_volume: return (354ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'serial'} {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 23:08:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: removing Cinder connection for volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: Updating volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "fYcPQBtT", "auth_password": "yFT0zqWXo8fv5J", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "ac3c66c1-2b71-42cf-a326-26b9636b3e69"}, "status": "reserved", "instance": "a8105968-7ab2-4423-8596-36996d55397f", "attached_at": "", "detached_at": "", "volume_id": "ac3c66c1-2b71-42cf-a326-26b9636b3e69", "serial": "ac3c66c1-2b71-42cf-a326-26b9636b3e69"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'no_device': None, 'attachment_id': 'a5d8f164-9e6b-400c-a881-fbd1e5a40383'} {{(pid=75621) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-200922b7-d0ec-40f8-a3bf-2ed6891ce469 tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.353s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:10 user nova-compute[75621]: INFO nova.compute.manager [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Attaching volume 634f1eed-4134-42fb-9fe4-2dc7e46496a8 to /dev/vdb
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3a71fa-33f8-4b2e-9aa8-79910a87c896]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db85c91a-17b9-4a8f-92bc-5696f573ad54]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273e656-0599-49df-a890-aee72b9dbec3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae41e8e6-4062-46a0-b781-0235b26ef8bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:08:10 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:08:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e31864-3a69-4c02-b12a-f0e1a454f599]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:10 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating existing volume attachment record: 3866a3bf-753c-4a2f-8781-0e368e0310ba {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.utils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8d29d2-7e4b-4e5a-851c-32cca3c5c609]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a7e0a-d664-4e01-91fe-39317acb4ced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b127929-9d9e-4f18-84bd-8d8dd91a2a97]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af687df1-3354-4805-9bbb-7d5d3da5f747]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:08:11 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:08:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2bb9fd-a750-426b-a3cb-d82303fa8ee5]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:08:11 user nova-compute[75621]: DEBUG os_brick.utils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:11 user nova-compute[75621]: INFO nova.compute.manager [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Swapping volume ac3c66c1-2b71-42cf-a326-26b9636b3e69 for 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:15 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:08:15 user nova-compute[75621]: INFO nova.compute.claims [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Claim successful on node user
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.675s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.028s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:08:16 user nova-compute[75621]: INFO nova.compute.claims [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Claim successful on node user
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:08:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.policy [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ef6cc601c4e455595057cb4d0dc33b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c922ea90054fc0b2220e2431ea900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:08:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Creating image(s)
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk 1073741824" returned: 0 in 0.062s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.735s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Successfully created port: 76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:08:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.policy [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ef6cc601c4e455595057cb4d0dc33b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c922ea90054fc0b2220e2431ea900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:08:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Creating image(s)
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Cannot resize image /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Ensure instance console log exists: /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Successfully updated port: 76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-changed-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Refreshing instance network info cache due to event network-changed-76823b6c-283b-4999-893a-8766802981ec. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk 1073741824" returned: 0 in 0.061s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Successfully created port: 3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:08:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Cannot resize image /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Ensure instance console log exists: /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance network_info: |[{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Refreshing network info cache for port 76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start _get_guest_xml network_info=[{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:08:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563489341',display_name='tempest-ServerRescueNegativeTestJSON-server-563489341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563489341',id=23,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-f81o6anz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:16Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=b9193c89-2a48-45c6-bbf2-2d7363bf565e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:08:18 user nova-compute[75621]:   <uuid>b9193c89-2a48-45c6-bbf2-2d7363bf565e</uuid>
Nov 27 23:08:18 user nova-compute[75621]:   <name>instance-00000017</name>
Nov 27 23:08:18 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:08:18 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:08:18 user nova-compute[75621]:   <metadata>
Nov 27 23:08:18 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:08:18 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-563489341</nova:name>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:08:18</nova:creationTime>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:08:18 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:08:18 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:owner>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:08:18 user nova-compute[75621]:       </nova:owner>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:08:18 user nova-compute[75621]:       <nova:ports>
Nov 27 23:08:18 user nova-compute[75621]:         <nova:port uuid="76823b6c-283b-4999-893a-8766802981ec">
Nov 27 23:08:18 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:08:18 user nova-compute[75621]:         </nova:port>
Nov 27 23:08:18 user nova-compute[75621]:       </nova:ports>
Nov 27 23:08:18 user nova-compute[75621]:     </nova:instance>
Nov 27 23:08:18 user nova-compute[75621]:   </metadata>
Nov 27 23:08:18 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:08:18 user nova-compute[75621]:     <system>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="serial">b9193c89-2a48-45c6-bbf2-2d7363bf565e</entry>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="uuid">b9193c89-2a48-45c6-bbf2-2d7363bf565e</entry>
Nov 27 23:08:18 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:08:18 user nova-compute[75621]:     </system>
Nov 27 23:08:18 user nova-compute[75621]:   </sysinfo>
Nov 27 23:08:18 user nova-compute[75621]:   <os>
Nov 27 23:08:18 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:08:18 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:08:18 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:08:18 user nova-compute[75621]:   </os>
Nov 27 23:08:18 user nova-compute[75621]:   <features>
Nov 27 23:08:18 user nova-compute[75621]:     <acpi/>
Nov 27 23:08:18 user nova-compute[75621]:     <apic/>
Nov 27 23:08:18 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:08:18 user nova-compute[75621]:   </features>
Nov 27 23:08:18 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:08:18 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:08:18 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:08:18 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:08:18 user nova-compute[75621]:   </clock>
Nov 27 23:08:18 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:08:18 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:08:18 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:08:18 user nova-compute[75621]:   </cpu>
Nov 27 23:08:18 user nova-compute[75621]:   <devices>
Nov 27 23:08:18 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:08:18 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:08:18 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk"/>
Nov 27 23:08:18 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:08:18 user nova-compute[75621]:     </disk>
Nov 27 23:08:18 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:08:18 user nova-compute[75621]:       <mac address="fa:16:3e:5f:e8:d7"/>
Nov 27 23:08:18 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:18 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:08:18 user nova-compute[75621]:       <target dev="tap76823b6c-28"/>
Nov 27 23:08:18 user nova-compute[75621]:     </interface>
Nov 27 23:08:18 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:08:18 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/console.log" append="off"/>
Nov 27 23:08:18 user nova-compute[75621]:     </serial>
Nov 27 23:08:18 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:08:18 user nova-compute[75621]:     <video>
Nov 27 23:08:18 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:18 user nova-compute[75621]:     </video>
Nov 27 23:08:18 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:08:18 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:08:18 user nova-compute[75621]:     </rng>
Nov 27 23:08:18 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:08:18 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:08:18 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:08:18 user nova-compute[75621]:     </memballoon>
Nov 27 23:08:18 user nova-compute[75621]:   </devices>
Nov 27 23:08:18 user nova-compute[75621]: </domain>
Nov 27 23:08:18 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563489341',display_name='tempest-ServerRescueNegativeTestJSON-server-563489341',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563489341',id=23,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-f81o6anz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:16Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=b9193c89-2a48-45c6-bbf2-2d7363bf565e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_vif [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8226c3e4-52cb-5775-89f2-43b985bedb5f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76823b6c-28, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76823b6c-28, col_values=(('qos', UUID('c9b2cc25-ecfc-4f5c-9851-80db23eb01e3')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76823b6c-28, col_values=(('external_ids', {'iface-id': '76823b6c-283b-4999-893a-8766802981ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:e8:d7', 'vm-uuid': 'b9193c89-2a48-45c6-bbf2-2d7363bf565e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: INFO os_vif [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28')
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:5f:e8:d7, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Successfully updated port: 3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-changed-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Refreshing instance network info cache due to event network-changed-3972e087-3518-423e-9486-93d6a399f90c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] Acquiring lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:18 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[463feff9-e6d0-411f-b16d-f5eb381fa808]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:08:18 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3def09-7210-4880-9b6a-8903c7766e2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8] added
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6adb8f2-724c-4428-ba73-2a8ca4f97caa]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4567dff5-3aaf-4ac6-84eb-a9d478c0235c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqwrbXoj {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqwrbXoj" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ee5bdb-7efb-4fff-bbb5-3540d507711d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqwrbXoj'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e44018-2c5d-41b4-a6eb-ff55cc960b9d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b913ad99-343f-4426-af6a-b292ed0002fc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[140df84b-25a8-483e-b128-992dd01218de]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]
Nov 27 23:08:18 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefd4009-cbeb-434a-bc69-35eea24db3e8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a2d9ee-ad08-47e4-8d56-254b3cec1b00]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance network_info: |[{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] Acquired lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Refreshing network info cache for port 3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start _get_guest_xml network_info=[{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:08:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba78608-31a1-4261-9078-77270f425e60]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132236675',display_name='tempest-ServerRescueNegativeTestJSON-server-1132236675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132236675',id=24,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-kg4byl4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:17Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=8320d0ba-f01c-4d46-913f-2b125aaa759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:08:19 user nova-compute[75621]:   <uuid>8320d0ba-f01c-4d46-913f-2b125aaa759e</uuid>
Nov 27 23:08:19 user nova-compute[75621]:   <name>instance-00000018</name>
Nov 27 23:08:19 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:08:19 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:08:19 user nova-compute[75621]:   <metadata>
Nov 27 23:08:19 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:08:19 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1132236675</nova:name>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:08:18</nova:creationTime>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:08:19 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:08:19 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:owner>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:08:19 user nova-compute[75621]:       </nova:owner>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:08:19 user nova-compute[75621]:       <nova:ports>
Nov 27 23:08:19 user nova-compute[75621]:         <nova:port uuid="3972e087-3518-423e-9486-93d6a399f90c">
Nov 27 23:08:19 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:08:19 user nova-compute[75621]:         </nova:port>
Nov 27 23:08:19 user nova-compute[75621]:       </nova:ports>
Nov 27 23:08:19 user nova-compute[75621]:     </nova:instance>
Nov 27 23:08:19 user nova-compute[75621]:   </metadata>
Nov 27 23:08:19 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:08:19 user nova-compute[75621]:     <system>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="serial">8320d0ba-f01c-4d46-913f-2b125aaa759e</entry>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="uuid">8320d0ba-f01c-4d46-913f-2b125aaa759e</entry>
Nov 27 23:08:19 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:08:19 user nova-compute[75621]:     </system>
Nov 27 23:08:19 user nova-compute[75621]:   </sysinfo>
Nov 27 23:08:19 user nova-compute[75621]:   <os>
Nov 27 23:08:19 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:08:19 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:08:19 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:08:19 user nova-compute[75621]:   </os>
Nov 27 23:08:19 user nova-compute[75621]:   <features>
Nov 27 23:08:19 user nova-compute[75621]:     <acpi/>
Nov 27 23:08:19 user nova-compute[75621]:     <apic/>
Nov 27 23:08:19 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:08:19 user nova-compute[75621]:   </features>
Nov 27 23:08:19 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:08:19 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:08:19 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:08:19 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:08:19 user nova-compute[75621]:   </clock>
Nov 27 23:08:19 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:08:19 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:08:19 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:08:19 user nova-compute[75621]:   </cpu>
Nov 27 23:08:19 user nova-compute[75621]:   <devices>
Nov 27 23:08:19 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:08:19 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:08:19 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk"/>
Nov 27 23:08:19 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:08:19 user nova-compute[75621]:     </disk>
Nov 27 23:08:19 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:08:19 user nova-compute[75621]:       <mac address="fa:16:3e:f4:61:1a"/>
Nov 27 23:08:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:19 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:08:19 user nova-compute[75621]:       <target dev="tap3972e087-35"/>
Nov 27 23:08:19 user nova-compute[75621]:     </interface>
Nov 27 23:08:19 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:08:19 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/console.log" append="off"/>
Nov 27 23:08:19 user nova-compute[75621]:     </serial>
Nov 27 23:08:19 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:08:19 user nova-compute[75621]:     <video>
Nov 27 23:08:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:19 user nova-compute[75621]:     </video>
Nov 27 23:08:19 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:08:19 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:08:19 user nova-compute[75621]:     </rng>
Nov 27 23:08:19 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:08:19 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:08:19 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:08:19 user nova-compute[75621]:     </memballoon>
Nov 27 23:08:19 user nova-compute[75621]:   </devices>
Nov 27 23:08:19 user nova-compute[75621]: </domain>
Nov 27 23:08:19 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132236675',display_name='tempest-ServerRescueNegativeTestJSON-server-1132236675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132236675',id=24,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-kg4byl4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:17Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=8320d0ba-f01c-4d46-913f-2b125aaa759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_vif [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e05a6d8c-7a09-549c-8df5-adc1672c68f4', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3972e087-35, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3972e087-35, col_values=(('qos', UUID('c91ea441-4aa9-4e04-84b8-55ae42e107cb')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3972e087-35, col_values=(('external_ids', {'iface-id': '3972e087-3518-423e-9486-93d6a399f90c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:61:1a', 'vm-uuid': '8320d0ba-f01c-4d46-913f-2b125aaa759e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:19 user nova-compute[75621]: INFO os_vif [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35')
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:f4:61:1a, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updated VIF entry in instance network info cache for port 76823b6c-283b-4999-893a-8766802981ec. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'serial': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69'}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'serial'} {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1126a86e-2b30-4bf6-b525-170d5045232b req-24c842cd-b6aa-4462-babb-b211ba1ff9a2 service nova] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updated VIF entry in instance network info cache for port 3972e087-3518-423e-9486-93d6a399f90c. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64a6915f-4205-48e4-88df-9fdc24d1b4d8 req-4a41687b-e408-4a2e-8de9-bbcf9575ed49 service nova] Releasing lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23862356634396637', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862356634396637', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.766s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:19 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb897f9-4aaa-494f-8aea-61d37143365f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:08:19 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:08:19 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:08:19 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:08:19 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:08:19 user nova-compute[75621]:   <serial>634f1eed-4134-42fb-9fe4-2dc7e46496a8</serial>
Nov 27 23:08:19 user nova-compute[75621]: </disk>
Nov 27 23:08:19 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[980c10cd-07a6-4051-adc5-6b638727bf96]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5] added
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee067897-5be1-4795-a1ce-7313c92a32f2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5affb-2a4c-42c2-906f-f68b31e1efef]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krqElGfD {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v krqElGfD" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d73e0c8-5a74-44e2-9710-55606fc5de30]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'krqElGfD'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ccb7c3-4a74-473a-b022-8298524e55ba]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92de7d6-5837-4770-a3d8-8b2aa3e6d2c2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c5b145-3fc3-459e-8ad3-35d83333de41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]
Nov 27 23:08:20 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b169ef8b-a586-4cfe-8667-3522a22c2da5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[333af3ed-a5f2-45fa-b8ce-7f6c7a4a0f8d]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:20 user nova-compute[75621]: WARNING nova.compute.manager [req-e4b6bb64-03bc-4a19-9191-a83de2b6fb1f req-cf9c68fc-f560-405b-a6f4-4430588e6f83 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state building and task_state spawning.
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f44b64-c7dd-4339-a6cd-99c568f9ef3e]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== connect_volume: return (2156ms) {'type': 'block', 'scsi_wwn': '23634383735666661', 'path': '/dev/sdg'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634383735666661', 'path': '/dev/sdg'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lazy-loading 'flavor' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No VIF found with MAC fa:16:3e:53:e7:12, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fc25ec7b-b273-4367-850b-35f4c168df1a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.860s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:22 user nova-compute[75621]: WARNING nova.compute.manager [req-2db96cf4-95f3-4035-a28e-8853e1b536b7 req-a53fef1f-5b87-4f2c-b05f-c6d92a460d2e service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state building and task_state spawning.
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 8388608 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:22 user nova-compute[75621]: WARNING nova.compute.manager [req-79e93fd9-1aaf-4d29-8e7d-2cbe25c6b6c2 req-1132baac-a212-475f-ba68-300b454f7e6b service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state building and task_state spawning.
Nov 27 23:08:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 177209344 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 367001600 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 551550976 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:24 user nova-compute[75621]: WARNING nova.compute.manager [req-f07413c1-4393-471d-949c-ffd021b3a552 req-9b627cba-d3ff-42c0-9e05-42cda3fcc934 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state building and task_state spawning.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 719323136 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance spawned successfully.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance spawned successfully.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 889192448 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Took 7.46 seconds to spawn the instance on the hypervisor.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Took 8.28 seconds to spawn the instance on the hypervisor.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.compute.manager [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Took 8.64 seconds to build instance.
Nov 27 23:08:24 user nova-compute[75621]: INFO nova.compute.manager [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Took 9.32 seconds to build instance.
Nov 27 23:08:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-db466671-86aa-4f6a-a1e9-511f539b920e tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.749s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581503-fbc7-413f-a5d8-832384d51369 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.449s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 1059061760 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fYcPQBtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'ac3c66c1-2b71-42cf-a326-26b9636b3e69'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:25 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6b110-6421-4d54-af59-3dfa5f94cfe7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:08:25 user nova-compute[75621]: No targets found.
Nov 27 23:08:25 user nova-compute[75621]: iSNS:
Nov 27 23:08:25 user nova-compute[75621]: No targets found.
Nov 27 23:08:25 user nova-compute[75621]: STATIC:
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:08:25 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:25 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:25 user nova-compute[75621]: FIRMWARE:
Nov 27 23:08:25 user nova-compute[75621]: No targets found.
Nov 27 23:08:25 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:08:25 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:08:25 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[516efed6-97af-4fbc-83ae-e7b074314175]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ece5e46-0bff-4fce-a2bf-66b5cc90cec1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:25 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1301217520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb39ae7-09c5-47a8-b653-83027321fcac]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ca7d43-bd00-4322-80d5-7929b6b01bb4]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c8f593-6da6-4cca-b466-e0ff956b2e4d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dfcb98-88cb-4ed9-9b6a-6b03b1e178db]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:08:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67e1284-345d-4ad2-a620-fffb71c91cf3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbeaf927-7325-4d2a-8daa-ef097574c0c2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260]
Nov 27 23:08:26 user nova-compute[75621]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:26 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac3c66c1-2b71-42cf-a326-26b9636b3e69 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[74da333d-3a8f-4e6a-aaa6-9ee197552f79]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] <== disconnect_volume: return (349ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'a8105968-7ab2-4423-8596-36996d55397f', 'attached_at': '', 'detached_at': '', 'volume_id': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'serial'} {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 27 23:08:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: removing Cinder connection for volume ac3c66c1-2b71-42cf-a326-26b9636b3e69 {{(pid=75621) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 27 23:08:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] [instance: a8105968-7ab2-4423-8596-36996d55397f] swap_volume: Updating volume ac3c66c1-2b71-42cf-a326-26b9636b3e69 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "krqElGfD", "auth_password": "C6e4wmIHn5SQ1U", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "59dd246e-cb3c-44a8-8ba2-ce7d6db936c5"}, "status": "reserved", "instance": "a8105968-7ab2-4423-8596-36996d55397f", "attached_at": "", "detached_at": "", "volume_id": "59dd246e-cb3c-44a8-8ba2-ce7d6db936c5", "serial": "59dd246e-cb3c-44a8-8ba2-ce7d6db936c5"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'no_device': None, 'attachment_id': 'e7a2d9ac-38f7-429f-a969-d9ee020dca50'} {{(pid=75621) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 27 23:08:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-be34e328-2494-4106-b5c4-84e0cdabc6ab tempest-TestVolumeSwap-1807059649 tempest-TestVolumeSwap-1807059649-project-admin] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.750s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:28 user nova-compute[75621]: INFO nova.compute.manager [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Detaching volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:28 user nova-compute[75621]: INFO nova.virt.block_device [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Attempting to driver detach volume 59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 from mountpoint /dev/vdb
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Attempting to detach device vdb from instance a8105968-7ab2-4423-8596-36996d55397f from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:08:28 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:08:28 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:08:28 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:08:28 user nova-compute[75621]:   <serial>59dd246e-cb3c-44a8-8ba2-ce7d6db936c5</serial>
Nov 27 23:08:28 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:08:28 user nova-compute[75621]: </disk>
Nov 27 23:08:28 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:08:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Successfully detached device vdb from instance a8105968-7ab2-4423-8596-36996d55397f from the persistent domain config.
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a8105968-7ab2-4423-8596-36996d55397f from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:08:28 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:08:28 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:08:28 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:08:28 user nova-compute[75621]:   <serial>59dd246e-cb3c-44a8-8ba2-ce7d6db936c5</serial>
Nov 27 23:08:28 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:08:28 user nova-compute[75621]: </disk>
Nov 27 23:08:28 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing instance network info cache due to event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:08:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:29 user nova-compute[75621]: DEBUG nova.network.neutron [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updated VIF entry in instance network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:08:29 user nova-compute[75621]: DEBUG nova.network.neutron [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-06d36610-200d-439c-8f5a-1c27b116e90f req-d0875310-491f-4b8c-9cd2-56eb0521edf6 service nova] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing instance network info cache due to event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updated VIF entry in instance network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-10d930ee-9952-40ac-a34b-3a3995a6f825 req-b1d70de0-fb6f-4f74-b43a-a1aed200088a service nova] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:35 user nova-compute[75621]: INFO nova.compute.manager [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Rebooting instance
Nov 27 23:08:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:35 user nova-compute[75621]: DEBUG nova.network.neutron [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:36 user nova-compute[75621]: WARNING nova.compute.manager [req-18720d07-3cd0-4f0c-bdc6-2ab05d152c05 req-17b2c9db-73a6-467f-bfa8-94bdc61a2fe0 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state active and task_state reboot_started_hard.
Nov 27 23:08:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance destroyed successfully.
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'resources' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:08:36Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80fb97ee-75, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b2c7974-49a2-4c4b-a329-0d1644db084d) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:37 user nova-compute[75621]: INFO os_vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75')
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e175e-e103-4a94-bb81-9b88b7fc9c94]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:08:37 user nova-compute[75621]: No targets found.
Nov 27 23:08:37 user nova-compute[75621]: iSNS:
Nov 27 23:08:37 user nova-compute[75621]: No targets found.
Nov 27 23:08:37 user nova-compute[75621]: STATIC:
Nov 27 23:08:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:08:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:08:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:08:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:08:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:37 user nova-compute[75621]: FIRMWARE:
Nov 27 23:08:37 user nova-compute[75621]: No targets found.
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:08:37 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:08:37 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b20090-35c3-4c39-91a4-09db4547f449]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb89c8-add0-4431-949e-63c6bcc7db35]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1304091e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[30810022-197e-40e0-a94a-92e68bc08ee9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ea376d-6e55-4146-b6f5-d3cb64059bcc]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca416fb-8c26-4688-a4a2-9c2f559e98ac]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fbc99d-7e83-4afe-b78c-40f6b134beba]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df3ac70-b5e9-4265-a085-0c386cc10a5c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f102a4fc-0e16-4fc4-843b-b2c8a50eb61e]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]
Nov 27 23:08:37 user nova-compute[75621]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd68ef4-7693-4bf4-a3a5-eb462b76479c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== disconnect_volume: return (315ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start _get_guest_xml network_info=[{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b169800-4748-4605-a719-b42ec98e471d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6b169800-4748-4605-a719-b42ec98e471d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '3866a3bf-753c-4a2f-8781-0e368e0310ba', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '68e5429b-9bdf-4f71-8a6b-fd446c8a08a2', 'attached_at': '', 'detached_at': '', 'volume_id': '634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'serial': '634f1eed-4134-42fb-9fe4-2dc7e46496a8'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:08:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6b169800-4748-4605-a719-b42ec98e471d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.objects.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Object Instance<68e5429b-9bdf-4f71-8a6b-fd446c8a08a2> lazy-loaded attributes: resources,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:37 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2170feb2-93db-434b-839e-ee7279fee3ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:08:37 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703d18e-9057-48ed-829c-599120f6f8fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8] added
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b3d2e2-13af-4a44-a1fe-6a784f7e3d8a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[370bc5c7-858b-4021-aba0-ab1ca3b22acd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqwrbXoj {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqwrbXoj" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ffa4d5-2616-4b1a-ac50-788a24df632e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqwrbXoj'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29c16f0-1070-4187-9590-32f69686baa9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e2639d-097a-41b8-a700-9e1cea7274e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab68c125-253a-4ffa-bcf5-568e5a5dd147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]
Nov 27 23:08:37 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f4aec0-07aa-46f3-862b-a210a86b19a3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2326f-9529-455b-856b-2bcb56fef14f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd02abf8-1c7f-4316-9c74-55fc005d3dc6]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:08:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:38 user nova-compute[75621]: INFO nova.compute.manager [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Terminating instance
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:38 user nova-compute[75621]: WARNING nova.compute.manager [req-17292b3f-f221-40b5-aeee-9e6e074d9c6d req-a5807359-9c5c-49fd-9119-bc4d2b1dbf28 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state active and task_state reboot_started_hard.
Nov 27 23:08:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23862356634396637', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862356634396637', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-unplugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] No waiting events found dispatching network-vif-unplugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-f70690e0-c434-468b-a17b-702f398510c7 req-a17859eb-3e7d-49b6-8d28-b4d0f17b4b83 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-unplugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:08:36Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.objects.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Object Instance<68e5429b-9bdf-4f71-8a6b-fd446c8a08a2> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:08:38 user nova-compute[75621]:   <uuid>68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</uuid>
Nov 27 23:08:38 user nova-compute[75621]:   <name>instance-00000013</name>
Nov 27 23:08:38 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:08:38 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:08:38 user nova-compute[75621]:   <metadata>
Nov 27 23:08:38 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:08:38 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:name>tempest-TestMinimumBasicScenario-server-1880807968</nova:name>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:08:37</nova:creationTime>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:08:38 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:08:38 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:owner>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:user uuid="22a7b251f7b641e184d1fc8bb44562b9">tempest-TestMinimumBasicScenario-1822102155-project-member</nova:user>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:project uuid="9b3b221a362d4bd6b7a057c97513a70b">tempest-TestMinimumBasicScenario-1822102155</nova:project>
Nov 27 23:08:38 user nova-compute[75621]:       </nova:owner>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:root type="image" uuid="6b169800-4748-4605-a719-b42ec98e471d"/>
Nov 27 23:08:38 user nova-compute[75621]:       <nova:ports>
Nov 27 23:08:38 user nova-compute[75621]:         <nova:port uuid="80fb97ee-75ec-475b-86f0-78e09f6c177b">
Nov 27 23:08:38 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:08:38 user nova-compute[75621]:         </nova:port>
Nov 27 23:08:38 user nova-compute[75621]:       </nova:ports>
Nov 27 23:08:38 user nova-compute[75621]:     </nova:instance>
Nov 27 23:08:38 user nova-compute[75621]:   </metadata>
Nov 27 23:08:38 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:08:38 user nova-compute[75621]:     <system>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="serial">68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</entry>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="uuid">68e5429b-9bdf-4f71-8a6b-fd446c8a08a2</entry>
Nov 27 23:08:38 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:08:38 user nova-compute[75621]:     </system>
Nov 27 23:08:38 user nova-compute[75621]:   </sysinfo>
Nov 27 23:08:38 user nova-compute[75621]:   <os>
Nov 27 23:08:38 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:08:38 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:08:38 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:08:38 user nova-compute[75621]:   </os>
Nov 27 23:08:38 user nova-compute[75621]:   <features>
Nov 27 23:08:38 user nova-compute[75621]:     <acpi/>
Nov 27 23:08:38 user nova-compute[75621]:     <apic/>
Nov 27 23:08:38 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:08:38 user nova-compute[75621]:   </features>
Nov 27 23:08:38 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:08:38 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:08:38 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:08:38 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:08:38 user nova-compute[75621]:   </clock>
Nov 27 23:08:38 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:08:38 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:08:38 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:08:38 user nova-compute[75621]:   </cpu>
Nov 27 23:08:38 user nova-compute[75621]:   <devices>
Nov 27 23:08:38 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:08:38 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:08:38 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk"/>
Nov 27 23:08:38 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:08:38 user nova-compute[75621]:     </disk>
Nov 27 23:08:38 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:08:38 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:08:38 user nova-compute[75621]:       <source dev="/dev/sde"/>
Nov 27 23:08:38 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:08:38 user nova-compute[75621]:       <serial>634f1eed-4134-42fb-9fe4-2dc7e46496a8</serial>
Nov 27 23:08:38 user nova-compute[75621]:     </disk>
Nov 27 23:08:38 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:08:38 user nova-compute[75621]:       <mac address="fa:16:3e:53:e7:12"/>
Nov 27 23:08:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:38 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:08:38 user nova-compute[75621]:       <target dev="tap80fb97ee-75"/>
Nov 27 23:08:38 user nova-compute[75621]:     </interface>
Nov 27 23:08:38 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:08:38 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/console.log" append="off"/>
Nov 27 23:08:38 user nova-compute[75621]:     </serial>
Nov 27 23:08:38 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:08:38 user nova-compute[75621]:     <video>
Nov 27 23:08:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:38 user nova-compute[75621]:     </video>
Nov 27 23:08:38 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:08:38 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:08:38 user nova-compute[75621]:     </rng>
Nov 27 23:08:38 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:08:38 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:08:38 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:08:38 user nova-compute[75621]:     </memballoon>
Nov 27 23:08:38 user nova-compute[75621]:   </devices>
Nov 27 23:08:38 user nova-compute[75621]: </domain>
Nov 27 23:08:38 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:08:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Instance destroyed successfully.
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lazy-loading 'resources' on Instance uuid f948f863-c506-4198-82e0-d04e5374a47a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1103629513',display_name='tempest-ServersNegativeTestJSON-server-1103629513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1103629513',id=20,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-3vt6ke81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:06:55Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=f948f863-c506-4198-82e0-d04e5374a47a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "address": "fa:16:3e:7f:5c:50", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb74aad3-27", "ovs_interfaceid": "cb74aad3-272c-4fd5-afc8-f82409fe0cde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG os_vif [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb74aad3-27, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea8eccef-4e3c-47bf-b365-96495c172c1b) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: INFO os_vif [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:5c:50,bridge_name='br-int',has_traffic_filtering=True,id=cb74aad3-272c-4fd5-afc8-f82409fe0cde,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb74aad3-27')
Nov 27 23:08:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Deleting instance files /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a_del
Nov 27 23:08:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Deletion of /opt/stack/data/nova/instances/f948f863-c506-4198-82e0-d04e5374a47a_del complete
Nov 27 23:08:39 user nova-compute[75621]: INFO nova.compute.manager [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Took 0.74 seconds to destroy the instance on the hypervisor.
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.objects.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Object Instance<68e5429b-9bdf-4f71-8a6b-fd446c8a08a2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Cannot resize image /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'migration_context' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.objects.base [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Object Instance<68e5429b-9bdf-4f71-8a6b-fd446c8a08a2> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:36Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG os_vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8da9045e-3ab4-5175-9c29-0d67213ce7ca', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80fb97ee-75, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80fb97ee-75, col_values=(('qos', UUID('ec8a0416-c886-4913-8221-c0cc8f1250ae')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80fb97ee-75, col_values=(('external_ids', {'iface-id': '80fb97ee-75ec-475b-86f0-78e09f6c177b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:e7:12', 'vm-uuid': '68e5429b-9bdf-4f71-8a6b-fd446c8a08a2'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:39 user nova-compute[75621]: INFO os_vif [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75')
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:40 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Took 0.70 seconds to deallocate network for instance.
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.442s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:40 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Deleted allocations for instance f948f863-c506-4198-82e0-d04e5374a47a
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-892d5a46-ae01-4cd0-a0f2-18656d5200cf req-70f138d5-aa0e-46ba-ba85-b6f2935d45aa service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-deleted-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a7fc1b9d-09b9-4366-b243-556020bdeb14 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "f948f863-c506-4198-82e0-d04e5374a47a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] Acquiring lock "f948f863-c506-4198-82e0-d04e5374a47a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] Lock "f948f863-c506-4198-82e0-d04e5374a47a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] No waiting events found dispatching network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:40 user nova-compute[75621]: WARNING nova.compute.manager [req-3605156d-1d4c-431e-a96b-38aa51be025b req-fbe15974-3743-44bb-860b-efcac154a490 service nova] [instance: f948f863-c506-4198-82e0-d04e5374a47a] Received unexpected event network-vif-plugged-cb74aad3-272c-4fd5-afc8-f82409fe0cde for instance with vm_state deleted and task_state None.
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:42 user nova-compute[75621]: WARNING nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state active and task_state reboot_started_hard.
Nov 27 23:08:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:08:42 user nova-compute[75621]: WARNING nova.compute.manager [req-3b426ae4-318a-4bb7-9712-84240ac2805d req-85db5444-a769-4338-b7d1-1bb6a93d5946 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state active and task_state reboot_started_hard.
Nov 27 23:08:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:08:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance rebooted successfully.
Nov 27 23:08:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:08:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6a10a757-019b-4cb3-844b-33917c195e7a tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.017s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:48 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a8105968-7ab2-4423-8596-36996d55397f is timed out.
Nov 27 23:08:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Successfully detached device vdb from instance a8105968-7ab2-4423-8596-36996d55397f from the live domain config.
Nov 27 23:08:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'krqElGfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': '59dd246e-cb3c-44a8-8ba2-ce7d6db936c5'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:08:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[10782a4a-34d6-45ac-9399-c19b772357a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:08:48 user nova-compute[75621]: No targets found.
Nov 27 23:08:48 user nova-compute[75621]: iSNS:
Nov 27 23:08:48 user nova-compute[75621]: No targets found.
Nov 27 23:08:48 user nova-compute[75621]: STATIC:
Nov 27 23:08:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:08:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5
Nov 27 23:08:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:08:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:08:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:08:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:08:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:08:48 user nova-compute[75621]: FIRMWARE:
Nov 27 23:08:48 user nova-compute[75621]: No targets found.
Nov 27 23:08:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:08:48 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:08:48 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4dfd406-3120-47e9-a9b6-112c7ea29785]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf4c96e-ad77-47d4-ac0f-d92a284509d0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:08:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e077df30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5'): ({'sdg'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Removing single pathed devices sdg {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba9bc9-d21d-4627-812d-3ea729ef4d9f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a62d4b-c1cd-4f28-a846-001abbc25927]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Flushing IO for device /dev/sdg {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[982e17ef-a8e9-411f-83a1-34bcd6a82aed]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b056db-cf6b-4ad7-bd0c-3a653dcf697a]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:08:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[21832f86-8b0e-41d7-b896-e4dead5243c2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce79a28-5a65-4e0b-9d98-1856d62f88df]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260]
Nov 27 23:08:49 user nova-compute[75621]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5, portal: 172.16.0.220,3260] successful.
Nov 27 23:08:49 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59dd246e-cb3c-44a8-8ba2-ce7d6db936c5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd46a07-a2e8-4d50-8c64-ab02d8fce059]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] <== disconnect_volume: return (325ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lazy-loading 'flavor' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ceb2946c-9fe5-48d7-99a4-8e55f28785cd tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:08:52 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:08:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquired lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'info_cache' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Releasing lock "refresh_cache-b04a6cd0-3193-4b86-8563-1d889000e76e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:08:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance destroyed successfully.
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'resources' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG os_vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b9f496e-43, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30716e07-6403-4435-88dd-67cacb6da456) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:56 user nova-compute[75621]: INFO os_vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start _get_guest_xml network_info=[{"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'numa_topology' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'vcpu_model' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'pci_devices' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:08:56 user nova-compute[75621]:   <uuid>b04a6cd0-3193-4b86-8563-1d889000e76e</uuid>
Nov 27 23:08:56 user nova-compute[75621]:   <name>instance-00000004</name>
Nov 27 23:08:56 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:08:56 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:08:56 user nova-compute[75621]:   <metadata>
Nov 27 23:08:56 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:08:56 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeTestJSON-server-1291519920</nova:name>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:08:56</nova:creationTime>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:08:56 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:08:56 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:owner>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:user uuid="cc5cf604fbfd4f1dbdbe80b05f540425">tempest-AttachVolumeTestJSON-1955560544-project-member</nova:user>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:project uuid="ea584e6a3e6b441d8fdec3f91a1c23ed">tempest-AttachVolumeTestJSON-1955560544</nova:project>
Nov 27 23:08:56 user nova-compute[75621]:       </nova:owner>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:08:56 user nova-compute[75621]:       <nova:ports>
Nov 27 23:08:56 user nova-compute[75621]:         <nova:port uuid="1b9f496e-4328-4bc8-9744-d6e3d2c3df4f">
Nov 27 23:08:56 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:08:56 user nova-compute[75621]:         </nova:port>
Nov 27 23:08:56 user nova-compute[75621]:       </nova:ports>
Nov 27 23:08:56 user nova-compute[75621]:     </nova:instance>
Nov 27 23:08:56 user nova-compute[75621]:   </metadata>
Nov 27 23:08:56 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:08:56 user nova-compute[75621]:     <system>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="serial">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="uuid">b04a6cd0-3193-4b86-8563-1d889000e76e</entry>
Nov 27 23:08:56 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:08:56 user nova-compute[75621]:     </system>
Nov 27 23:08:56 user nova-compute[75621]:   </sysinfo>
Nov 27 23:08:56 user nova-compute[75621]:   <os>
Nov 27 23:08:56 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:08:56 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:08:56 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:08:56 user nova-compute[75621]:   </os>
Nov 27 23:08:56 user nova-compute[75621]:   <features>
Nov 27 23:08:56 user nova-compute[75621]:     <acpi/>
Nov 27 23:08:56 user nova-compute[75621]:     <apic/>
Nov 27 23:08:56 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:08:56 user nova-compute[75621]:   </features>
Nov 27 23:08:56 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:08:56 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:08:56 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:08:56 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:08:56 user nova-compute[75621]:   </clock>
Nov 27 23:08:56 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:08:56 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:08:56 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:08:56 user nova-compute[75621]:   </cpu>
Nov 27 23:08:56 user nova-compute[75621]:   <devices>
Nov 27 23:08:56 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:08:56 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:08:56 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk"/>
Nov 27 23:08:56 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:08:56 user nova-compute[75621]:     </disk>
Nov 27 23:08:56 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:08:56 user nova-compute[75621]:       <mac address="fa:16:3e:0e:a3:79"/>
Nov 27 23:08:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:56 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:08:56 user nova-compute[75621]:       <target dev="tap1b9f496e-43"/>
Nov 27 23:08:56 user nova-compute[75621]:     </interface>
Nov 27 23:08:56 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:08:56 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/console.log" append="off"/>
Nov 27 23:08:56 user nova-compute[75621]:     </serial>
Nov 27 23:08:56 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:08:56 user nova-compute[75621]:     <video>
Nov 27 23:08:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:08:56 user nova-compute[75621]:     </video>
Nov 27 23:08:56 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:08:56 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:08:56 user nova-compute[75621]:     </rng>
Nov 27 23:08:56 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:08:56 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:08:56 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:08:56 user nova-compute[75621]:     </memballoon>
Nov 27 23:08:56 user nova-compute[75621]:   </devices>
Nov 27 23:08:56 user nova-compute[75621]: </domain>
Nov 27 23:08:56 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'trusted_certs' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Cannot resize image /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'migration_context' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.objects.base [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Object Instance<b04a6cd0-3193-4b86-8563-1d889000e76e> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG os_vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27256700-d9e3-5738-9fb4-eee93f739db8', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1b9f496e-43, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1b9f496e-43, col_values=(('qos', UUID('9bc9cd13-68fc-41d0-b9cb-ed90913d980f')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1b9f496e-43, col_values=(('external_ids', {'iface-id': '1b9f496e-4328-4bc8-9744-d6e3d2c3df4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a3:79', 'vm-uuid': 'b04a6cd0-3193-4b86-8563-1d889000e76e'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:08:57 user nova-compute[75621]: INFO os_vif [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:08:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:09:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:01 user nova-compute[75621]: WARNING nova.compute.manager [req-c6a05141-221c-470e-8fc7-cff1b5659155 req-dc066745-8f62-4a13-bb56-fea289456afc service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state powering-on.
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:01 user nova-compute[75621]: WARNING nova.compute.manager [req-61ec7519-3ba9-4215-8774-80fc11c1a855 req-e31ea153-f0a2-44a2-bc3c-9ae910cc88f7 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state stopped and task_state powering-on.
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:09:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance rebooted successfully.
Nov 27 23:09:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7054MB free_disk=24.95925521850586GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f096e15c-3a1a-4eb2-8ca8-23c00050c1c8 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance a8105968-7ab2-4423-8596-36996d55397f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:09:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:09:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [{"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-db2447ed-f456-41e5-b4bd-2dc243ad6c33" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:09:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-changed-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Refreshing instance network info cache due to event network-changed-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:09:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] Acquiring lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] Acquired lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Refreshing network info cache for port 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:09:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updated VIF entry in instance network info cache for port 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:09:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6fa9cafe-9d3f-4857-b4e0-6d01b198c3a7 req-e358d11d-0d48-4faf-896c-e0e8e26d5cf5 service nova] Releasing lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:10 user nova-compute[75621]: INFO nova.compute.manager [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attaching volume 11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 to /dev/vdb
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[280015b1-b0ca-453a-aa89-4894ba54f81b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abd3723-593f-4f19-9a33-87657b884169]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76446ce4-1165-4bc6-a93c-33f5d237122d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c682c1a-bed6-4c05-bd61-bf93f78a0f1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:09:10 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:09:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f09860-73dc-4d53-9bb6-4318987183ca]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:10 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating existing volume attachment record: f642edde-0c53-4e26-8de6-e93e57f4ee52 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:09:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXsDyjIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:17 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:17 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:17 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc19167-6970-4050-8667-e42697e26c69]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:09:17 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cd38fa-b1a4-4d06-a4ce-694eb005cd12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0] added
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c1d883-cb4f-417f-b760-761c5a74fae1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5895ee-8d09-4886-91b2-59a4bb9f272e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXsDyjIL {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXsDyjIL" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b6c0f0-2ce8-4fa1-81a1-4f78824875ca]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXsDyjIL'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f491218-1e51-4a96-8c83-67c7bae450d7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4468086b-be13-4c55-a760-408b63a4ffb4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb21d25b-9659-4af1-ae4d-37b567e1cbcb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260]
Nov 27 23:09:17 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260] successful.
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3018e3-1d48-485d-9e27-1681dc01fe0a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f8052f-72ec-4b4e-b6b1-5f75c09aa4a4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca52857-6179-42a1-87fe-f0223c2c2ee3]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:09:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXsDyjIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:18 user nova-compute[75621]: INFO nova.compute.manager [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Terminating instance
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-unplugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] No waiting events found dispatching network-vif-unplugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-d9f9fdec-5f83-43d0-bcc8-6c0f0565601c req-d2c172b4-8a71-4ecc-b4d2-bf82ffd40d46 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-unplugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23162396566336430', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162396566336430', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:09:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:09:19 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:19 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:09:19 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:19 user nova-compute[75621]:   <serial>11eeb688-cd3c-428a-a66c-1c3ffd3e92a0</serial>
Nov 27 23:09:19 user nova-compute[75621]: </disk>
Nov 27 23:09:19 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] Instance destroyed successfully.
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lazy-loading 'resources' on Instance uuid a8105968-7ab2-4423-8596-36996d55397f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2132521757',display_name='tempest-TestVolumeSwap-server-2132521757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2132521757',id=17,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuni9XGmpKMfrSj/y0BwkcQJFrVBUk3TdYvqKEErkuNC/8/yy9GXdTwvDCVQf4iyx6NFBsijrWfZC39TGE4tAz06R3K1jwCMLws2r2v/b3n5nTOw0AMkUN2nfmFvvpVUA==',key_name='tempest-keypair-1854963224',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ca878afb27024c96805509fa25a68ad6',ramdisk_id='',reservation_id='r-04ma3h5m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-658299879',owner_user_name='tempest-TestVolumeSwap-658299879-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c8bcb7c9d0e4134b98ab1124efa2b78',uuid=a8105968-7ab2-4423-8596-36996d55397f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converting VIF {"id": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "address": "fa:16:3e:3f:6d:3f", "network": {"id": "1a957281-3c45-4b46-80bd-1b2e0c20d336", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1542305633-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ca878afb27024c96805509fa25a68ad6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ac5733a-20", "ovs_interfaceid": "7ac5733a-2058-40e6-9da9-33e12a0c9ac8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG os_vif [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ac5733a-20, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb041312-e820-4d21-b0ea-f45558dd00d3) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:19 user nova-compute[75621]: INFO os_vif [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:6d:3f,bridge_name='br-int',has_traffic_filtering=True,id=7ac5733a-2058-40e6-9da9-33e12a0c9ac8,network=Network(1a957281-3c45-4b46-80bd-1b2e0c20d336),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ac5733a-20')
Nov 27 23:09:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Deleting instance files /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f_del
Nov 27 23:09:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Deletion of /opt/stack/data/nova/instances/a8105968-7ab2-4423-8596-36996d55397f_del complete
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No VIF found with MAC fa:16:3e:59:85:77, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:09:19 user nova-compute[75621]: INFO nova.compute.manager [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] [instance: a8105968-7ab2-4423-8596-36996d55397f] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 27 23:09:19 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:09:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac4ebf73-5b2d-4c72-9eae-798cee472bbc tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.268s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:20 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: a8105968-7ab2-4423-8596-36996d55397f] Took 1.17 seconds to deallocate network for instance.
Nov 27 23:09:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] Acquiring lock "a8105968-7ab2-4423-8596-36996d55397f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] Lock "a8105968-7ab2-4423-8596-36996d55397f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] No waiting events found dispatching network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:20 user nova-compute[75621]: WARNING nova.compute.manager [req-96775b03-5f82-4e3e-a915-956f8734e6dd req-516a6608-4865-4f84-aabc-a76ff18a8404 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received unexpected event network-vif-plugged-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 for instance with vm_state active and task_state deleting.
Nov 27 23:09:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-338fbf2b-3bbf-4664-96c4-25e2501a2602 req-be9efcce-7b83-4e0e-90ef-6a2f5f948461 service nova] [instance: a8105968-7ab2-4423-8596-36996d55397f] Received event network-vif-deleted-7ac5733a-2058-40e6-9da9-33e12a0c9ac8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:21 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:09:21 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:09:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.409s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:21 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Deleted allocations for instance a8105968-7ab2-4423-8596-36996d55397f
Nov 27 23:09:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5eb700-abc3-4f50-a9fb-d99a5766da2f tempest-TestVolumeSwap-658299879 tempest-TestVolumeSwap-658299879-project-member] Lock "a8105968-7ab2-4423-8596-36996d55397f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.911s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:09:29 user nova-compute[75621]: INFO nova.compute.claims [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Claim successful on node user
Nov 27 23:09:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.599s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:09:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.policy [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506743bc2ab54538b400595de8792b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef81acb6ed764a23a83269df20981c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:09:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Creating image(s)
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk 1073741824" returned: 0 in 0.111s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Successfully created port: a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Cannot resize image /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Ensure instance console log exists: /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:31 user nova-compute[75621]: INFO nova.compute.manager [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Terminating instance
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing instance network info cache due to event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-447f1c8d-b341-47b8-9d0a-b17d525aaa5d req-174cfea3-90b1-465f-b1dd-3bc294414aa4 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-unplugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updated VIF entry in instance network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4d927f33-8b67-4df0-a725-15f57ecd14ec req-bd667c55-d105-4f64-b913-bd1c061e7505 service nova] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Instance destroyed successfully.
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lazy-loading 'resources' on Instance uuid db2447ed-f456-41e5-b4bd-2dc243ad6c33 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-774787445',display_name='tempest-ServerActionsTestOtherB-server-774787445',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-774787445',id=2,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+PF48RHXY9zGPEjHBZN+9DC34I1ezn5vMhEkPltRUd3LCyuGbl2tQbe3sIXmaU+Ra7+9HjfZICAVL5XMB2bAznuyN7++ka185/+iDcMNF2dYt4rD7jX7ddJTICH82zBg==',key_name='tempest-keypair-908177398',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='776ddd88f0e543769f6e275217231ecd',ramdisk_id='',reservation_id='r-jivfv3ns',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-236791637',owner_user_name='tempest-ServerActionsTestOtherB-236791637-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f116260296b94e55916e029d103f2126',uuid=db2447ed-f456-41e5-b4bd-2dc243ad6c33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converting VIF {"id": "37e89c03-0357-46ad-9765-d16725a8dca6", "address": "fa:16:3e:c7:38:3e", "network": {"id": "23fc8951-877b-4768-ad69-5986d5b29f0f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2099597084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "776ddd88f0e543769f6e275217231ecd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e89c03-03", "ovs_interfaceid": "37e89c03-0357-46ad-9765-d16725a8dca6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_vif [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e89c03-03, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3ed43a2-4783-4597-85f4-5c96456ed840) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:09:32 user nova-compute[75621]: INFO os_vif [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:38:3e,bridge_name='br-int',has_traffic_filtering=True,id=37e89c03-0357-46ad-9765-d16725a8dca6,network=Network(23fc8951-877b-4768-ad69-5986d5b29f0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e89c03-03')
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YcTuhSKy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:32 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa66ddf-c34f-4f65-81fe-e7e3338528da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:09:32 user nova-compute[75621]: No targets found.
Nov 27 23:09:32 user nova-compute[75621]: iSNS:
Nov 27 23:09:32 user nova-compute[75621]: No targets found.
Nov 27 23:09:32 user nova-compute[75621]: STATIC:
Nov 27 23:09:32 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a
Nov 27 23:09:32 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:32 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:32 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:09:32 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:32 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:32 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:09:32 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:32 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:32 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0
Nov 27 23:09:32 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:32 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:32 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:09:32 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:32 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:32 user nova-compute[75621]: FIRMWARE:
Nov 27 23:09:32 user nova-compute[75621]: No targets found.
Nov 27 23:09:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:09:32 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:09:32 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8621f0d0-a16f-4c78-9c62-fa8311628f60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d79088-83a5-4b48-b4f2-1eeba578cf42]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f1301224ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9692717b-ff25-4bce-a677-e7717259fc93]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[43437709-f254-44d1-9cc1-4d43975b3b2b]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[89eabc10-f00e-438c-baec-8f058f5055f0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca7b8ee-fdda-4434-8499-6711585c9e86]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b027147-bdb5-45d7-91e9-041d385eae5a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Successfully updated port: a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c568a3b4-3f28-4357-93eb-4c10fd4f6ec4]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260]
Nov 27 23:09:32 user nova-compute[75621]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a, portal: 172.16.0.220,3260] successful.
Nov 27 23:09:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4203dc00-ff03-4099-ad7d-021d6c07a20a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b0550-dd20-44c1-bfe5-432593319ea8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] <== disconnect_volume: return (337ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:09:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Deleting instance files /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_del
Nov 27 23:09:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Deletion of /opt/stack/data/nova/instances/db2447ed-f456-41e5-b4bd-2dc243ad6c33_del complete
Nov 27 23:09:32 user nova-compute[75621]: INFO nova.compute.manager [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Updating instance_info_cache with network_info: [{"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Instance network_info: |[{"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Start _get_guest_xml network_info=[{"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:09:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377140387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377140387',id=25,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-yyqt3klk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:09:30Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=0f0eef2e-b116-4f58-a23a-af764f533bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f0eef2e-b116-4f58-a23a-af764f533bf9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:09:32 user nova-compute[75621]:   <uuid>0f0eef2e-b116-4f58-a23a-af764f533bf9</uuid>
Nov 27 23:09:32 user nova-compute[75621]:   <name>instance-00000019</name>
Nov 27 23:09:32 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:09:32 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:09:32 user nova-compute[75621]:   <metadata>
Nov 27 23:09:32 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:09:32 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-377140387</nova:name>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:09:32</nova:creationTime>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:09:32 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:09:32 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:owner>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:09:32 user nova-compute[75621]:       </nova:owner>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:09:32 user nova-compute[75621]:       <nova:ports>
Nov 27 23:09:32 user nova-compute[75621]:         <nova:port uuid="a556b0ae-7e6d-49bf-991e-97e284bcb79f">
Nov 27 23:09:32 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:09:32 user nova-compute[75621]:         </nova:port>
Nov 27 23:09:32 user nova-compute[75621]:       </nova:ports>
Nov 27 23:09:32 user nova-compute[75621]:     </nova:instance>
Nov 27 23:09:32 user nova-compute[75621]:   </metadata>
Nov 27 23:09:32 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:09:32 user nova-compute[75621]:     <system>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="serial">0f0eef2e-b116-4f58-a23a-af764f533bf9</entry>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="uuid">0f0eef2e-b116-4f58-a23a-af764f533bf9</entry>
Nov 27 23:09:32 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:09:32 user nova-compute[75621]:     </system>
Nov 27 23:09:32 user nova-compute[75621]:   </sysinfo>
Nov 27 23:09:32 user nova-compute[75621]:   <os>
Nov 27 23:09:32 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:09:32 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:09:32 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:09:32 user nova-compute[75621]:   </os>
Nov 27 23:09:32 user nova-compute[75621]:   <features>
Nov 27 23:09:32 user nova-compute[75621]:     <acpi/>
Nov 27 23:09:32 user nova-compute[75621]:     <apic/>
Nov 27 23:09:32 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:09:32 user nova-compute[75621]:   </features>
Nov 27 23:09:32 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:09:32 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:09:32 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:09:32 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:09:32 user nova-compute[75621]:   </clock>
Nov 27 23:09:32 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:09:32 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:09:32 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:09:32 user nova-compute[75621]:   </cpu>
Nov 27 23:09:32 user nova-compute[75621]:   <devices>
Nov 27 23:09:32 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:09:32 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:09:32 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk"/>
Nov 27 23:09:32 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:09:32 user nova-compute[75621]:     </disk>
Nov 27 23:09:32 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:09:32 user nova-compute[75621]:       <mac address="fa:16:3e:1c:12:fa"/>
Nov 27 23:09:32 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:09:32 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:09:32 user nova-compute[75621]:       <target dev="tapa556b0ae-7e"/>
Nov 27 23:09:32 user nova-compute[75621]:     </interface>
Nov 27 23:09:32 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:09:32 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/console.log" append="off"/>
Nov 27 23:09:32 user nova-compute[75621]:     </serial>
Nov 27 23:09:32 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:09:32 user nova-compute[75621]:     <video>
Nov 27 23:09:32 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:09:32 user nova-compute[75621]:     </video>
Nov 27 23:09:32 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:09:32 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:09:32 user nova-compute[75621]:     </rng>
Nov 27 23:09:32 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:09:32 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:09:32 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:09:32 user nova-compute[75621]:     </memballoon>
Nov 27 23:09:32 user nova-compute[75621]:   </devices>
Nov 27 23:09:32 user nova-compute[75621]: </domain>
Nov 27 23:09:32 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377140387',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377140387',id=25,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-yyqt3klk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:09:30Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=0f0eef2e-b116-4f58-a23a-af764f533bf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG os_vif [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '207547a5-f902-5439-89d2-dc079bd2be38', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa556b0ae-7e, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa556b0ae-7e, col_values=(('qos', UUID('3e791d87-6248-476c-91ae-3133978afa0f')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa556b0ae-7e, col_values=(('external_ids', {'iface-id': 'a556b0ae-7e6d-49bf-991e-97e284bcb79f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:12:fa', 'vm-uuid': '0f0eef2e-b116-4f58-a23a-af764f533bf9'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:32 user nova-compute[75621]: INFO os_vif [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e')
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:1c:12:fa, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:33 user nova-compute[75621]: INFO nova.compute.manager [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Detaching volume 11eeb688-cd3c-428a-a66c-1c3ffd3e92a0
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:33 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Took 0.74 seconds to deallocate network for instance.
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-47b7b634-041f-4a14-9858-f58e928ad7d9 req-b1bccb82-8eb9-490a-9f09-e86f163d7198 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-deleted-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:33 user nova-compute[75621]: INFO nova.compute.manager [req-47b7b634-041f-4a14-9858-f58e928ad7d9 req-b1bccb82-8eb9-490a-9f09-e86f163d7198 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Neutron deleted interface 37e89c03-0357-46ad-9765-d16725a8dca6; detaching it from the instance and deleting it from the info cache
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-47b7b634-041f-4a14-9858-f58e928ad7d9 req-b1bccb82-8eb9-490a-9f09-e86f163d7198 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-47b7b634-041f-4a14-9858-f58e928ad7d9 req-b1bccb82-8eb9-490a-9f09-e86f163d7198 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Detach interface failed, port_id=37e89c03-0357-46ad-9765-d16725a8dca6, reason: Instance db2447ed-f456-41e5-b4bd-2dc243ad6c33 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:09:33 user nova-compute[75621]: INFO nova.virt.block_device [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attempting to driver detach volume 11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 from mountpoint /dev/vdb
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Attempting to detach device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:09:33 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:33 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:09:33 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:33 user nova-compute[75621]:   <serial>11eeb688-cd3c-428a-a66c-1c3ffd3e92a0</serial>
Nov 27 23:09:33 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:09:33 user nova-compute[75621]: </disk>
Nov 27 23:09:33 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:09:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config.
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:09:33 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:33 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:09:33 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:33 user nova-compute[75621]:   <serial>11eeb688-cd3c-428a-a66c-1c3ffd3e92a0</serial>
Nov 27 23:09:33 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:09:33 user nova-compute[75621]: </disk>
Nov 27 23:09:33 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Acquiring lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] No waiting events found dispatching network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:33 user nova-compute[75621]: WARNING nova.compute.manager [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Received unexpected event network-vif-plugged-37e89c03-0357-46ad-9765-d16725a8dca6 for instance with vm_state active and task_state deleting.
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-changed-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Refreshing instance network info cache due to event network-changed-a556b0ae-7e6d-49bf-991e-97e284bcb79f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Acquiring lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Acquired lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Refreshing network info cache for port a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:09:34 user nova-compute[75621]: INFO nova.compute.manager [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] [instance: db2447ed-f456-41e5-b4bd-2dc243ad6c33] Took 0.77 seconds to detach 1 volumes for instance.
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Updated VIF entry in instance network info cache for port a556b0ae-7e6d-49bf-991e-97e284bcb79f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Updating instance_info_cache with network_info: [{"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c35974a2-0da2-4424-8281-a591fc9528b5 req-12df61c7-7aea-42c7-8296-18ea1b9dba23 service nova] Releasing lock "refresh_cache-0f0eef2e-b116-4f58-a23a-af764f533bf9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:34 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Deleted allocations for instance db2447ed-f456-41e5-b4bd-2dc243ad6c33
Nov 27 23:09:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c82f1e56-106b-4032-a17b-d54f86f754e7 tempest-ServerActionsTestOtherB-236791637 tempest-ServerActionsTestOtherB-236791637-project-member] Lock "db2447ed-f456-41e5-b4bd-2dc243ad6c33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.484s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:34 user nova-compute[75621]: WARNING nova.compute.manager [req-1f4c86a2-a76f-43f6-92f9-424408c57f39 req-efeeb0b6-8a5f-4538-afc8-bdcc67853378 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state building and task_state spawning.
Nov 27 23:09:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:35 user nova-compute[75621]: INFO nova.compute.manager [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Shelving
Nov 27 23:09:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance destroyed successfully.
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Beginning cold snapshot process
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk /opt/stack/data/nova/instances/snapshots/tmpw7r1cnxb/23a81e8619bb498d855cbc8c0dfe5663 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Instance spawned successfully.
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.compute.manager [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Detaching volume f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:36 user nova-compute[75621]: WARNING nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state building and task_state spawning.
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:36 user nova-compute[75621]: WARNING nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:36 user nova-compute[75621]: WARNING nova.compute.manager [req-507a25d6-b3a5-4913-bda8-e9ea02868227 req-e3e7cdd0-8601-4468-8c0d-d6482c57e477 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.virt.block_device [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Attempting to driver detach volume f542dabd-5266-46fb-a1cf-99903712ee24 from mountpoint /dev/vdb
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Attempting to detach device vdb from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:09:36 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:36 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:09:36 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:36 user nova-compute[75621]:   <serial>f542dabd-5266-46fb-a1cf-99903712ee24</serial>
Nov 27 23:09:36 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:09:36 user nova-compute[75621]: </disk>
Nov 27 23:09:36 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully detached device vdb from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the persistent domain config.
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:09:36 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:36 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:09:36 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:36 user nova-compute[75621]:   <serial>f542dabd-5266-46fb-a1cf-99903712ee24</serial>
Nov 27 23:09:36 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:09:36 user nova-compute[75621]: </disk>
Nov 27 23:09:36 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:09:36 user nova-compute[75621]: INFO nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Took 6.75 seconds to spawn the instance on the hypervisor.
Nov 27 23:09:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:09:37 user nova-compute[75621]: INFO nova.compute.manager [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Took 7.73 seconds to build instance.
Nov 27 23:09:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d0c2c797-7d1c-4d7f-b840-8dde4f514ec5 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.834s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk /opt/stack/data/nova/instances/snapshots/tmpw7r1cnxb/23a81e8619bb498d855cbc8c0dfe5663" returned: 0 in 0.812s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Snapshot extracted, beginning image upload
Nov 27 23:09:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:09:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Snapshot image upload complete
Nov 27 23:09:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:09:39 user nova-compute[75621]: INFO nova.compute.manager [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Shelve offloading
Nov 27 23:09:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance destroyed successfully.
Nov 27 23:09:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:09:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:39 user nova-compute[75621]: DEBUG nova.network.neutron [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance destroyed successfully.
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'resources' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjFmWjrV/uV4RjnK4/QTWN3j4patv1h4FdIT8+U3PAhRRGxNdu9C6Ov1gP/640O+qsHILAi5acywQgBhIywJQtZJLfkhQH/aThAmLWzZEy45f+Tgc0FjzZKXiak5IepuQ==',key_name='tempest-keypair-131461733',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:09:39.594356',shelved_host='user',shelved_image_id='5bd07699-0653-45f9-a79a-331e61adb67a'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG os_vif [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad192969-9c, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3c40954-6075-474e-889e-5cfded3c7ea9) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:09:40 user nova-compute[75621]: INFO os_vif [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c')
Nov 27 23:09:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Deleting instance files /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340_del
Nov 27 23:09:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Deletion of /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340_del complete
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing instance network info cache due to event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:09:40 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Deleted allocations for instance 993ba2a7-2dc0-46f2-8fff-45395e01e340
Nov 27 23:09:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'numa_topology' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:40 user nova-compute[75621]: DEBUG nova.objects.base [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<993ba2a7-2dc0-46f2-8fff-45395e01e340> lazy-loaded attributes: resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG nova.network.neutron [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updated VIF entry in instance network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG nova.network.neutron [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapad192969-9c", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-842eb5b1-6a8b-464b-8096-a5dc7a435af4 req-44869dd0-1a88-49de-86fb-71edc3a5d9a7 service nova] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fb71214f-1fc8-4e07-a975-3c2331669060 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.042s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'flavor' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:43 user nova-compute[75621]: INFO nova.compute.manager [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attaching volume baed5c3d-f972-467b-9222-7d23abedba1e to /dev/vdb
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52156a2f-fd19-4798-b6b0-ce6e493af11c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73987a36-d129-47bb-911e-39030b0ff59d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[586fc6ac-c425-4b37-9164-11c4ee47463a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a693b708-39e2-4eaf-8b44-929f0200eab2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:09:43 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:09:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcf8b4c-aa3f-420b-87c7-4f305b56c95c]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:43 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating existing volume attachment record: 1cabe734-3d4d-40eb-a5fd-6f443a87ff8b {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:09:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:46 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:09:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:50 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe6e7d-d3e8-4425-a64b-620614c9a444]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:09:50 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5f0c0-aa6a-4aa0-8a7b-a5852f0c73bd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e] added
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[010aad64-9a0c-4c62-a01b-39f4e0fcdf3d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96893ca-49d9-4364-b30b-472758465054]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWmGfJR {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWmGfJR" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[544aafab-66db-4ee8-9e72-d1f9af5b9edc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjWmGfJR'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa8aab2-76cd-47f9-9afc-257c1203865a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cafcb0-8fc4-4266-b321-4a81fba51ecf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b55f3a1-7efb-4a9a-91ae-1d34fa59f9a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260]
Nov 27 23:09:50 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260] successful.
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6e02bb-b675-4453-9ea0-532d97acc054]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f926f35e-7128-4ed7-980f-c4af6a60a62c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:50 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76c92f-7949-4148-bd0e-46234358ef5c]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26337383264306533', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337383264306533', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:09:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'flavor' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:09:51 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:51 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:09:51 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:09:51 user nova-compute[75621]:   <serial>baed5c3d-f972-467b-9222-7d23abedba1e</serial>
Nov 27 23:09:51 user nova-compute[75621]: </disk>
Nov 27 23:09:51 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:09:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No VIF found with MAC fa:16:3e:40:dd:9e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:09:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a74ae063-3d76-44c4-af61-3d6b195479c2 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.075s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:53 user nova-compute[75621]: INFO nova.compute.manager [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Rescuing
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:53 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:54 user nova-compute[75621]: WARNING nova.compute.manager [req-3cb15700-707e-473e-86ea-3d3cf3626a33 req-0c6475f8-2452-4f01-8ff4-c4ab22b47b63 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state active and task_state rescuing.
Nov 27 23:09:54 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 is timed out.
Nov 27 23:09:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config.
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXsDyjIL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:54 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e563c986-02f7-4f06-8578-994ad33aab85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:09:54 user nova-compute[75621]: No targets found.
Nov 27 23:09:54 user nova-compute[75621]: iSNS:
Nov 27 23:09:54 user nova-compute[75621]: No targets found.
Nov 27 23:09:54 user nova-compute[75621]: STATIC:
Nov 27 23:09:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:09:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:09:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:09:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0
Nov 27 23:09:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:09:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:54 user nova-compute[75621]: FIRMWARE:
Nov 27 23:09:54 user nova-compute[75621]: No targets found.
Nov 27 23:09:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:09:54 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:09:54 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce20b038-1001-4b8e-9abd-11018154176d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[852386d1-0e45-461f-a90c-f808b378c7bb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 (non-flash)
Nov 27 23:09:54 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130018db40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[89266646-b3e3-4f32-809e-2cb3291f2804]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c565af1a-e6a5-4757-a623-018e4dd2dc33]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a805d2e6-672f-44ec-9cd3-45486cf4184a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c849d2-1e1d-4895-b242-6a4f8f691b15]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d5a5fe-4d1e-4219-85ef-a2928f72456a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[394b8a64-8374-41e4-9d59-a45792ff8eda]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260]
Nov 27 23:09:54 user nova-compute[75621]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0, portal: 172.16.0.220,3260] successful.
Nov 27 23:09:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11eeb688-cd3c-428a-a66c-1c3ffd3e92a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32681375-8778-45cd-865a-1e046efaef98]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== disconnect_volume: return (332ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:09:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance destroyed successfully.
Nov 27 23:09:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attempting a stable device rescue
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:09:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Creating image(s)
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'trusted_certs' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d49e4ae7-9ae1-4456-b1a3-5516d73a0b97 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.361s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG nova.virt.images [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] 479813b6-af3f-4bf4-b84f-9baf27e5e0f8 was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.part /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:09:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.part /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.converted" returned: 0 in 0.421s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:56 user nova-compute[75621]: WARNING nova.compute.manager [req-586eead5-7898-4cf5-909e-7d999b93df7f req-8dbff994-f109-4d43-bee2-f1c52257a0f6 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state active and task_state rescuing.
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.640s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6 --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6,backing_fmt=raw /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6,backing_fmt=raw /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue" returned: 0 in 0.080s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "f749b71473e9140b8e696986c54c8b4179fc5fe6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'migration_context' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Object Instance<c536051b-9b80-4df7-8903-3b0db3a9050e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start _get_guest_xml network_info=[{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "vif_mac": "fa:16:3e:40:dd:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '479813b6-af3f-4bf4-b84f-9baf27e5e0f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '1cabe734-3d4d-40eb-a5fd-6f443a87ff8b', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'c536051b-9b80-4df7-8903-3b0db3a9050e', 'attached_at': '', 'detached_at': '', 'volume_id': 'baed5c3d-f972-467b-9222-7d23abedba1e', 'serial': 'baed5c3d-f972-467b-9222-7d23abedba1e'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'resources' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Object Instance<c536051b-9b80-4df7-8903-3b0db3a9050e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'numa_topology' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Object Instance<c536051b-9b80-4df7-8903-3b0db3a9050e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:56 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'vcpu_model' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Object Instance<c536051b-9b80-4df7-8903-3b0db3a9050e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:56 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:56 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:56 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e201ada-d78b-43a2-ac68-d5fce858a540]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hjWmGfJR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 23:09:56 user nova-compute[75621]: node.name = iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:09:56 user nova-compute[75621]: node.tpgt = -1
Nov 27 23:09:56 user nova-compute[75621]: node.startup = automatic
Nov 27 23:09:56 user nova-compute[75621]: node.leading_login = No
Nov 27 23:09:56 user nova-compute[75621]: iface.iscsi_ifacename = default
Nov 27 23:09:56 user nova-compute[75621]: iface.net_ifacename = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.ipaddress = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.prefix_len = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.hwaddress = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.transport_name = tcp
Nov 27 23:09:56 user nova-compute[75621]: iface.initiatorname = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.vlan_id = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.vlan_priority = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.vlan_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.iface_num = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.mtu = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.port = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.bootproto = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.subnet_mask = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.gateway = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_alt_client_id = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_dns = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_learn_iqn = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_vendor_id_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_vendor_id = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.dhcp_slp_da = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.fragmentation = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.gratuitous_arp = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.incoming_forwarding = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.tos_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.tos = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.ttl = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.delayed_ack = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.tcp_nagle = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.tcp_wsf_state = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.tcp_wsf = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.tcp_timer_scale = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.tcp_timestamp = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.redirect = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.def_task_mgmt_timeout = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.header_digest = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.data_digest = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.immediate_data = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.initial_r2t = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.data_seq_inorder = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.data_pdu_inorder = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.erl = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.max_receive_data_len = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.first_burst_len = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.max_outstanding_r2t = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.max_burst_len = 0
Nov 27 23:09:56 user nova-compute[75621]: iface.chap_auth = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.bidi_chap = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.strict_login_compliance = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.discovery_auth = <empty>
Nov 27 23:09:56 user nova-compute[75621]: iface.discovery_logout = <empty>
Nov 27 23:09:56 user nova-compute[75621]: node.discovery_address = <empty>
Nov 27 23:09:56 user nova-compute[75621]: node.discovery_port = 0
Nov 27 23:09:56 user nova-compute[75621]: node.discovery_type = static
Nov 27 23:09:56 user nova-compute[75621]: node.session.initial_cmdsn = 0
Nov 27 23:09:56 user nova-compute[75621]: node.session.initial_login_retry_max = 8
Nov 27 23:09:56 user nova-compute[75621]: node.session.xmit_thread_priority = -20
Nov 27 23:09:56 user nova-compute[75621]: node.session.cmds_max = 128
Nov 27 23:09:56 user nova-compute[75621]: node.session.queue_depth = 32
Nov 27 23:09:56 user nova-compute[75621]: node.session.nr_sessions = 1
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.authmethod = CHAP
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.username = hjWmGfJR
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.password = ***
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.username_in = <empty>
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.password_in = <empty>
Nov 27 23:09:56 user nova-compute[75621]: node.session.auth.chap_algs = MD5
Nov 27 23:09:56 user nova-compute[75621]: node.session.timeo.replacement_timeout = 120
Nov 27 23:09:56 user nova-compute[75621]: node.session.err_timeo.abort_timeout = 15
Nov 27 23:09:56 user nova-compute[75621]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 23:09:56 user nova-compute[75621]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 23:09:56 user nova-compute[75621]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.FastAbort = Yes
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.InitialR2T = No
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.ImmediateData = Yes
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.MaxConnections = 1
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 23:09:56 user nova-compute[75621]: node.session.iscsi.ERL = 0
Nov 27 23:09:56 user nova-compute[75621]: node.session.scan = manual
Nov 27 23:09:56 user nova-compute[75621]: node.session.reopen_max = 0
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].address = 172.16.0.220
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].port = 3260
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].startup = manual
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].tcp.window_size = 524288
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].tcp.type_of_service = 0
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].timeo.logout_timeout = 15
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].timeo.login_timeout = 15
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].timeo.auth_timeout = 45
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.DataDigest = None
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.IFMarker = No
Nov 27 23:09:56 user nova-compute[75621]: node.conn[0].iscsi.OFMarker = No
Nov 27 23:09:56 user nova-compute[75621]: # END RECORD
Nov 27 23:09:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60bb634-854e-4e92-bb66-b5645db30080]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5265778-3f95-410d-a16b-09b37c079b1f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWmGfJR {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hjWmGfJR" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5b3f8-e831-4c02-adbb-c3795cd60a9f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hjWmGfJR'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad6064c-b573-4d0d-ae93-317a3180ce1e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e056d91-c9fa-4b0d-85ee-14f8ba034582]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:56 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.176s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] HCTL ('35', '0', '0', 0) found on session 29 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410d9a4-bebf-4528-9efe-8b24157f6f95]: (4, ('0 0 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Searching for a device in session 29 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.200s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] <== connect_volume: return (200ms) {'type': 'block', 'scsi_wwn': '26337383264306533', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337383264306533', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1425970357',display_name='tempest-ServerStableDeviceRescueTest-server-1425970357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1425970357',id=18,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq5yF8DSj7abh0f8z8HoIS9bHyO3inf8ShuA1FDnHEUIbSWMrEIi/hPpoLYLBr0EFqZ4um0kWCoydZrS/bUq8hKtwxF5akLVEPB60+Bz4gtIIqE4sWE1du5C7RJSr7t6w==',key_name='tempest-keypair-17915930',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe1cd748f87c4bb89ed90e11966cf34c',ramdisk_id='',reservation_id='r-0ozdxk1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-784559379',owner_user_name='tempest-ServerStableDeviceRescueTest-784559379-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:07:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bd541264d3d49d4a6af59c1fc0765d7',uuid=c536051b-9b80-4df7-8903-3b0db3a9050e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "vif_mac": "fa:16:3e:40:dd:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converting VIF {"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "vif_mac": "fa:16:3e:40:dd:9e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'pci_devices' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.objects.base [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Object Instance<c536051b-9b80-4df7-8903-3b0db3a9050e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:09:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:09:56 user nova-compute[75621]:   <uuid>c536051b-9b80-4df7-8903-3b0db3a9050e</uuid>
Nov 27 23:09:56 user nova-compute[75621]:   <name>instance-00000012</name>
Nov 27 23:09:56 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:09:56 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:09:56 user nova-compute[75621]:   <metadata>
Nov 27 23:09:56 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:09:56 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1425970357</nova:name>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:09:56</nova:creationTime>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:09:56 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:09:56 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:owner>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:user uuid="1bd541264d3d49d4a6af59c1fc0765d7">tempest-ServerStableDeviceRescueTest-784559379-project-member</nova:user>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:project uuid="fe1cd748f87c4bb89ed90e11966cf34c">tempest-ServerStableDeviceRescueTest-784559379</nova:project>
Nov 27 23:09:56 user nova-compute[75621]:       </nova:owner>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:09:56 user nova-compute[75621]:       <nova:ports>
Nov 27 23:09:56 user nova-compute[75621]:         <nova:port uuid="41832a48-3bfe-4379-b729-eb69507911ef">
Nov 27 23:09:56 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:09:56 user nova-compute[75621]:         </nova:port>
Nov 27 23:09:56 user nova-compute[75621]:       </nova:ports>
Nov 27 23:09:56 user nova-compute[75621]:     </nova:instance>
Nov 27 23:09:56 user nova-compute[75621]:   </metadata>
Nov 27 23:09:56 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:09:56 user nova-compute[75621]:     <system>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="serial">c536051b-9b80-4df7-8903-3b0db3a9050e</entry>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="uuid">c536051b-9b80-4df7-8903-3b0db3a9050e</entry>
Nov 27 23:09:56 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:09:56 user nova-compute[75621]:     </system>
Nov 27 23:09:56 user nova-compute[75621]:   </sysinfo>
Nov 27 23:09:56 user nova-compute[75621]:   <os>
Nov 27 23:09:56 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:09:56 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:09:56 user nova-compute[75621]:   </os>
Nov 27 23:09:56 user nova-compute[75621]:   <features>
Nov 27 23:09:56 user nova-compute[75621]:     <acpi/>
Nov 27 23:09:56 user nova-compute[75621]:     <apic/>
Nov 27 23:09:56 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:09:56 user nova-compute[75621]:   </features>
Nov 27 23:09:56 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:09:56 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:09:56 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:09:56 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:09:56 user nova-compute[75621]:   </clock>
Nov 27 23:09:56 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:09:56 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:09:56 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:09:56 user nova-compute[75621]:   </cpu>
Nov 27 23:09:56 user nova-compute[75621]:   <devices>
Nov 27 23:09:56 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:09:56 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:09:56 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk"/>
Nov 27 23:09:56 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:09:56 user nova-compute[75621]:     </disk>
Nov 27 23:09:56 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:09:56 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:09:56 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:09:56 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:09:56 user nova-compute[75621]:       <serial>baed5c3d-f972-467b-9222-7d23abedba1e</serial>
Nov 27 23:09:56 user nova-compute[75621]:     </disk>
Nov 27 23:09:56 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:09:56 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:09:56 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue"/>
Nov 27 23:09:56 user nova-compute[75621]:       <target dev="vdc" bus="virtio"/>
Nov 27 23:09:56 user nova-compute[75621]:       <boot order="1"/>
Nov 27 23:09:56 user nova-compute[75621]:     </disk>
Nov 27 23:09:56 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:09:56 user nova-compute[75621]:       <mac address="fa:16:3e:40:dd:9e"/>
Nov 27 23:09:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:09:56 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:09:56 user nova-compute[75621]:       <target dev="tap41832a48-3b"/>
Nov 27 23:09:56 user nova-compute[75621]:     </interface>
Nov 27 23:09:56 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:09:56 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/console.log" append="off"/>
Nov 27 23:09:56 user nova-compute[75621]:     </serial>
Nov 27 23:09:56 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:09:56 user nova-compute[75621]:     <video>
Nov 27 23:09:56 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:09:56 user nova-compute[75621]:     </video>
Nov 27 23:09:56 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:09:56 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:09:56 user nova-compute[75621]:     </rng>
Nov 27 23:09:56 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:09:56 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:09:56 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:09:56 user nova-compute[75621]:     </memballoon>
Nov 27 23:09:56 user nova-compute[75621]:   </devices>
Nov 27 23:09:56 user nova-compute[75621]: </domain>
Nov 27 23:09:56 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:09:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance destroyed successfully.
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] No VIF found with MAC fa:16:3e:40:dd:9e, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b is timed out.
Nov 27 23:09:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully detached device vdb from instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b from the live domain config.
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iTsIZgaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:09:57 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7e307-eca2-4659-92de-aaf62cb82649]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:09:57 user nova-compute[75621]: No targets found.
Nov 27 23:09:57 user nova-compute[75621]: iSNS:
Nov 27 23:09:57 user nova-compute[75621]: No targets found.
Nov 27 23:09:57 user nova-compute[75621]: STATIC:
Nov 27 23:09:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:09:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:09:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:09:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24
Nov 27 23:09:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:09:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:09:57 user nova-compute[75621]: FIRMWARE:
Nov 27 23:09:57 user nova-compute[75621]: No targets found.
Nov 27 23:09:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:09:57 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:09:57 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f7d294-2e5e-4230-8f30-4a4822a8adb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaafcc35-5ffc-49e1-8638-5dd1fca7af7c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:09:57 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:09:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07f7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[edec51d1-5b86-4031-859a-4fbcf2a3512e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f2e52-42f2-4830-9cff-395adf60e715]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea0fc07-638a-42ca-a5b9-88309ce9b1f0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f5fd1b-deeb-4cbc-be08-66c29db6b5f0]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cf96b6-b47a-47e1-a17f-77b2b904f841]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b52c3-8f92-47ff-9a28-459b25c7f8a7]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260]
Nov 27 23:09:57 user nova-compute[75621]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24, portal: 172.16.0.220,3260] successful.
Nov 27 23:09:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f542dabd-5266-46fb-a1cf-99903712ee24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f20103d-fbde-44a9-98ac-a69fca391400]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== disconnect_volume: return (362ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'flavor' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:09:58 user nova-compute[75621]: WARNING nova.compute.manager [req-cbf2ba2f-67c9-4e0e-9c88-b3d88b7fd267 req-15373ce8-b332-4e57-8325-9c5cf9080aeb service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state active and task_state rescuing.
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bbe5e13c-3e10-4e9b-906b-c66e1761d589 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.919s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:09:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7211MB free_disk=24.96318817138672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b04a6cd0-3193-4b86-8563-1d889000e76e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bf0983c2-0b44-474d-864f-21daec79a1c9 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:00 user nova-compute[75621]: WARNING nova.compute.manager [req-6634ab49-8e35-4e64-ae6d-2be937d9b787 req-b6191493-5722-4ffd-b30d-13433290c915 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state rescued and task_state None.
Nov 27 23:10:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:10:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:10:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:10:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:06 user nova-compute[75621]: INFO nova.compute.manager [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Rescuing
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:06 user nova-compute[75621]: WARNING nova.compute.manager [req-92d06024-bf74-480a-a939-2d229a6d8bfb req-50a5a72f-5cfc-4390-bf00-27115e8cc058 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state active and task_state rescuing.
Nov 27 23:10:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance destroyed successfully.
Nov 27 23:10:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Attempting rescue
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:10:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Creating image(s)
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue" returned: 0 in 0.047s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'migration_context' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<8320d0ba-f01c-4d46-913f-2b125aaa759e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start _get_guest_xml network_info=[{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:f4:61:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<8320d0ba-f01c-4d46-913f-2b125aaa759e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'numa_topology' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<8320d0ba-f01c-4d46-913f-2b125aaa759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:10:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<8320d0ba-f01c-4d46-913f-2b125aaa759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132236675',display_name='tempest-ServerRescueNegativeTestJSON-server-1132236675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132236675',id=24,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-kg4byl4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:25Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=8320d0ba-f01c-4d46-913f-2b125aaa759e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:f4:61:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:f4:61:1a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.objects.base [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<8320d0ba-f01c-4d46-913f-2b125aaa759e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:10:07 user nova-compute[75621]:   <uuid>8320d0ba-f01c-4d46-913f-2b125aaa759e</uuid>
Nov 27 23:10:07 user nova-compute[75621]:   <name>instance-00000018</name>
Nov 27 23:10:07 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:10:07 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:10:07 user nova-compute[75621]:   <metadata>
Nov 27 23:10:07 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:10:07 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1132236675</nova:name>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:10:07</nova:creationTime>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:10:07 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:10:07 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:owner>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:10:07 user nova-compute[75621]:       </nova:owner>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:10:07 user nova-compute[75621]:       <nova:ports>
Nov 27 23:10:07 user nova-compute[75621]:         <nova:port uuid="3972e087-3518-423e-9486-93d6a399f90c">
Nov 27 23:10:07 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:10:07 user nova-compute[75621]:         </nova:port>
Nov 27 23:10:07 user nova-compute[75621]:       </nova:ports>
Nov 27 23:10:07 user nova-compute[75621]:     </nova:instance>
Nov 27 23:10:07 user nova-compute[75621]:   </metadata>
Nov 27 23:10:07 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:10:07 user nova-compute[75621]:     <system>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="serial">8320d0ba-f01c-4d46-913f-2b125aaa759e</entry>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="uuid">8320d0ba-f01c-4d46-913f-2b125aaa759e</entry>
Nov 27 23:10:07 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:10:07 user nova-compute[75621]:     </system>
Nov 27 23:10:07 user nova-compute[75621]:   </sysinfo>
Nov 27 23:10:07 user nova-compute[75621]:   <os>
Nov 27 23:10:07 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:10:07 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:10:07 user nova-compute[75621]:   </os>
Nov 27 23:10:07 user nova-compute[75621]:   <features>
Nov 27 23:10:07 user nova-compute[75621]:     <acpi/>
Nov 27 23:10:07 user nova-compute[75621]:     <apic/>
Nov 27 23:10:07 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:10:07 user nova-compute[75621]:   </features>
Nov 27 23:10:07 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:10:07 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:10:07 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:10:07 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:10:07 user nova-compute[75621]:   </clock>
Nov 27 23:10:07 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:10:07 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:10:07 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:10:07 user nova-compute[75621]:   </cpu>
Nov 27 23:10:07 user nova-compute[75621]:   <devices>
Nov 27 23:10:07 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:10:07 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:10:07 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue"/>
Nov 27 23:10:07 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:10:07 user nova-compute[75621]:     </disk>
Nov 27 23:10:07 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:10:07 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:10:07 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk"/>
Nov 27 23:10:07 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:10:07 user nova-compute[75621]:     </disk>
Nov 27 23:10:07 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:10:07 user nova-compute[75621]:       <mac address="fa:16:3e:f4:61:1a"/>
Nov 27 23:10:07 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:10:07 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:10:07 user nova-compute[75621]:       <target dev="tap3972e087-35"/>
Nov 27 23:10:07 user nova-compute[75621]:     </interface>
Nov 27 23:10:07 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:10:07 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/console.log" append="off"/>
Nov 27 23:10:07 user nova-compute[75621]:     </serial>
Nov 27 23:10:07 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:10:07 user nova-compute[75621]:     <video>
Nov 27 23:10:07 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:10:07 user nova-compute[75621]:     </video>
Nov 27 23:10:07 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:10:07 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:10:07 user nova-compute[75621]:     </rng>
Nov 27 23:10:07 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:10:07 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:10:07 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:10:07 user nova-compute[75621]:     </memballoon>
Nov 27 23:10:07 user nova-compute[75621]:   </devices>
Nov 27 23:10:07 user nova-compute[75621]: </domain>
Nov 27 23:10:07 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:10:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance destroyed successfully.
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:10:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:f4:61:1a, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:10:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:09 user nova-compute[75621]: WARNING nova.compute.manager [req-7564c944-ae97-4734-871f-2ca53830ccfa req-9099e09b-3e4f-4194-a717-e2ca32fa1d73 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state active and task_state rescuing.
Nov 27 23:10:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:11 user nova-compute[75621]: WARNING nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state active and task_state rescuing.
Nov 27 23:10:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:11 user nova-compute[75621]: WARNING nova.compute.manager [req-5faad8b5-c789-460c-a510-ef0440c8ab9b req-fda17fd6-4aa9-49ae-938c-e64ea7da0eef service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state active and task_state rescuing.
Nov 27 23:10:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-92fedb34-2b11-4b33-b38d-1c11a5c7e047 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:10:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:26 user nova-compute[75621]: INFO nova.compute.manager [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attaching volume bbf0a068-6eff-483b-a0a3-37b00aad9455 to /dev/vdb
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae6a089-c54a-44ea-aa0f-cd41bde00c3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c080e0-8eec-4751-9805-82d9ec1dfd62]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8d7756-5a63-4830-853f-2c6ebcf1d90e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85120d8-ff3d-4d26-91eb-581093d5512f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:10:26 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:10:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c76628-d6f9-4223-8c0d-8971234b221e]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:10:26 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating existing volume attachment record: 5cbc9517-4503-47e0-a82b-0b061cddb1d6 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:27 user nova-compute[75621]: INFO nova.compute.manager [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Terminating instance
Nov 27 23:10:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-0390d4b9-ce02-49c7-9dc6-1586bde27672 req-61f3b942-5ee3-4c94-a06a-634e0687dab0 service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-unplugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:10:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Instance destroyed successfully.
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'resources' on Instance uuid ee90a2b7-403e-46ae-ab6b-a1caf604a98b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-523009238',display_name='tempest-ServerActionsTestOtherA-server-1783046998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-523009238',id=15,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChCB6KTUa7ukxMaEQ5m5zeP1866/AzgnTRT08z5CarkM/yFcJ7cIZAODrcV2rAZ1IHIxrI1qfPN0kvAo/ROP42YJq/6Vp9WBhLtbV+P1L5amyhw2PC42513OhJ01IGg0w==',key_name='tempest-keypair-734368511',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-0t3u95zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=ee90a2b7-403e-46ae-ab6b-a1caf604a98b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "address": "fa:16:3e:c3:51:c7", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ff5fc-0b", "ovs_interfaceid": "4a4ff5fc-0b77-4dba-b146-0ae201275cb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG os_vif [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a4ff5fc-0b, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing instance network info cache due to event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=75dbea1b-ed34-42ae-b81e-ca01bd672948) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:10:28 user nova-compute[75621]: INFO os_vif [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:51:c7,bridge_name='br-int',has_traffic_filtering=True,id=4a4ff5fc-0b77-4dba-b146-0ae201275cb9,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ff5fc-0b')
Nov 27 23:10:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Deleting instance files /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b_del
Nov 27 23:10:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Deletion of /opt/stack/data/nova/instances/ee90a2b7-403e-46ae-ab6b-a1caf604a98b_del complete
Nov 27 23:10:28 user nova-compute[75621]: INFO nova.compute.manager [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 27 23:10:28 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updated VIF entry in instance network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c43d591b-be95-4a93-8063-7f2e339832d2 req-7ac687ca-6e18-41bd-8c6b-26aec28a2130 service nova] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:29 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Took 1.15 seconds to deallocate network for instance.
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:29 user nova-compute[75621]: INFO nova.compute.manager [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Detaching volume 634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:10:29 user nova-compute[75621]: INFO nova.virt.block_device [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Attempting to driver detach volume 634f1eed-4134-42fb-9fe4-2dc7e46496a8 from mountpoint /dev/vdb
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Attempting to detach device vdb from instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:10:29 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:10:29 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:10:29 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:10:29 user nova-compute[75621]:   <serial>634f1eed-4134-42fb-9fe4-2dc7e46496a8</serial>
Nov 27 23:10:29 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:10:29 user nova-compute[75621]: </disk>
Nov 27 23:10:29 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:10:29 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully detached device vdb from instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 from the persistent domain config.
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:10:29 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:10:29 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:10:29 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:10:29 user nova-compute[75621]:   <serial>634f1eed-4134-42fb-9fe4-2dc7e46496a8</serial>
Nov 27 23:10:29 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:10:29 user nova-compute[75621]: </disk>
Nov 27 23:10:29 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.403s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] Acquiring lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] No waiting events found dispatching network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:29 user nova-compute[75621]: WARNING nova.compute.manager [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received unexpected event network-vif-plugged-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 for instance with vm_state deleted and task_state None.
Nov 27 23:10:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-dc8abdcb-2104-4b34-b874-bf09ed02ae03 req-a212a555-0d48-4200-bb4d-eb7e1f75d78e service nova] [instance: ee90a2b7-403e-46ae-ab6b-a1caf604a98b] Received event network-vif-deleted-4a4ff5fc-0b77-4dba-b146-0ae201275cb9 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:29 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Deleted allocations for instance ee90a2b7-403e-46ae-ab6b-a1caf604a98b
Nov 27 23:10:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e5bbc5b6-1086-45ac-9f5c-fcfad602aeb0 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "ee90a2b7-403e-46ae-ab6b-a1caf604a98b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.811s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing instance network info cache due to event network-changed-80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] Acquiring lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] Acquired lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Refreshing network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updated VIF entry in instance network info cache for port 80fb97ee-75ec-475b-86f0-78e09f6c177b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [{"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d051bab7-2d6b-4c32-a270-972a4c2c67c2 req-c998e085-96cb-4dc4-8613-77e28b360625 service nova] Releasing lock "refresh_cache-68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRFPnHDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:10:34 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:10:34 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:10:34 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a102b7-e3a7-472c-9da4-000e6059a996]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:10:34 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc600162-f13b-4cfd-8ace-42c2c88dff8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455] added
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c2a15-bc45-44e1-aba3-4aef1b039f20]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[68369ebe-f153-4124-97a9-53cf48444133]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRFPnHDQ {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uRFPnHDQ" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acb2afd-c137-4c9f-97ad-165a366b3015]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uRFPnHDQ'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[592a66b4-f2ce-47af-82fe-87f6b09e93aa]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33957b7-d41f-44b7-b6ec-686ce37da8bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c270df8-4b4f-4571-9556-28514ba73936]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260]
Nov 27 23:10:34 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260] successful.
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d46cf1-cf0a-45f0-a45a-9008a2c978ee]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5e518-3530-41f9-944b-d0e86c28a3bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:34 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6bc927-4d8b-4747-b3b9-b6e00969d01b]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:10:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRFPnHDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23833653332303036', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833653332303036', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:10:35 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:10:35 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:10:35 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:10:35 user nova-compute[75621]:   <serial>bbf0a068-6eff-483b-a0a3-37b00aad9455</serial>
Nov 27 23:10:35 user nova-compute[75621]: </disk>
Nov 27 23:10:35 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:35 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No VIF found with MAC fa:16:3e:59:85:77, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:10:36 user nova-compute[75621]: INFO nova.compute.claims [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Claim successful on node user
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c091137c-0e4f-442e-a32a-b5264c977d1c tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.692s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:10:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.policy [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c7f3a4fe69a492aab4db9062a6d838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565ce700aeda4eb49c85cd697a9c0736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:10:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Creating image(s)
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "/opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Successfully created port: 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Cannot resize image /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Ensure instance console log exists: /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:37 user nova-compute[75621]: INFO nova.compute.manager [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Detaching volume bbf0a068-6eff-483b-a0a3-37b00aad9455
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Successfully updated port: 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquired lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-changed-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Refreshing instance network info cache due to event network-changed-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:10:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] Acquiring lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:10:38 user nova-compute[75621]: INFO nova.virt.block_device [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attempting to driver detach volume bbf0a068-6eff-483b-a0a3-37b00aad9455 from mountpoint /dev/vdb
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Attempting to detach device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:10:38 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:10:38 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:10:38 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:10:38 user nova-compute[75621]:   <serial>bbf0a068-6eff-483b-a0a3-37b00aad9455</serial>
Nov 27 23:10:38 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:10:38 user nova-compute[75621]: </disk>
Nov 27 23:10:38 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:10:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config.
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:10:38 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:10:38 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:10:38 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:10:38 user nova-compute[75621]:   <serial>bbf0a068-6eff-483b-a0a3-37b00aad9455</serial>
Nov 27 23:10:38 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:10:38 user nova-compute[75621]: </disk>
Nov 27 23:10:38 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updating instance_info_cache with network_info: [{"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Releasing lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Instance network_info: |[{"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] Acquired lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Refreshing network info cache for port 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Start _get_guest_xml network_info=[{"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:10:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-11995816',display_name='tempest-AttachVolumeNegativeTest-server-11995816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-11995816',id=26,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYlP9gOsQrx15YDeP9yMNpDjcN++cT/seRssNMRres5iTpjUrdaGDDXA36tFADUVlMUOSnrzrU7SHlvY+29XncnkSeS5k86gB7ki9CZJi1XV/rnYSjqzHUGUZEZfvhOvg==',key_name='tempest-keypair-1495962700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-pxct34bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=144ce759-4144-4606-8a2d-90034d7f9129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'pci_devices' on Instance uuid 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:10:38 user nova-compute[75621]:   <uuid>144ce759-4144-4606-8a2d-90034d7f9129</uuid>
Nov 27 23:10:38 user nova-compute[75621]:   <name>instance-0000001a</name>
Nov 27 23:10:38 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:10:38 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:10:38 user nova-compute[75621]:   <metadata>
Nov 27 23:10:38 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:10:38 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeNegativeTest-server-11995816</nova:name>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:10:38</nova:creationTime>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:10:38 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:10:38 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:owner>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:user uuid="6c7f3a4fe69a492aab4db9062a6d838b">tempest-AttachVolumeNegativeTest-862898080-project-member</nova:user>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:project uuid="565ce700aeda4eb49c85cd697a9c0736">tempest-AttachVolumeNegativeTest-862898080</nova:project>
Nov 27 23:10:38 user nova-compute[75621]:       </nova:owner>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:10:38 user nova-compute[75621]:       <nova:ports>
Nov 27 23:10:38 user nova-compute[75621]:         <nova:port uuid="93c55381-bfcc-436d-aa32-9a0f4ee3e6f2">
Nov 27 23:10:38 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:10:38 user nova-compute[75621]:         </nova:port>
Nov 27 23:10:38 user nova-compute[75621]:       </nova:ports>
Nov 27 23:10:38 user nova-compute[75621]:     </nova:instance>
Nov 27 23:10:38 user nova-compute[75621]:   </metadata>
Nov 27 23:10:38 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:10:38 user nova-compute[75621]:     <system>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="serial">144ce759-4144-4606-8a2d-90034d7f9129</entry>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="uuid">144ce759-4144-4606-8a2d-90034d7f9129</entry>
Nov 27 23:10:38 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:10:38 user nova-compute[75621]:     </system>
Nov 27 23:10:38 user nova-compute[75621]:   </sysinfo>
Nov 27 23:10:38 user nova-compute[75621]:   <os>
Nov 27 23:10:38 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:10:38 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:10:38 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:10:38 user nova-compute[75621]:   </os>
Nov 27 23:10:38 user nova-compute[75621]:   <features>
Nov 27 23:10:38 user nova-compute[75621]:     <acpi/>
Nov 27 23:10:38 user nova-compute[75621]:     <apic/>
Nov 27 23:10:38 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:10:38 user nova-compute[75621]:   </features>
Nov 27 23:10:38 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:10:38 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:10:38 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:10:38 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:10:38 user nova-compute[75621]:   </clock>
Nov 27 23:10:38 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:10:38 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:10:38 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:10:38 user nova-compute[75621]:   </cpu>
Nov 27 23:10:38 user nova-compute[75621]:   <devices>
Nov 27 23:10:38 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:10:38 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:10:38 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk"/>
Nov 27 23:10:38 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:10:38 user nova-compute[75621]:     </disk>
Nov 27 23:10:38 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:10:38 user nova-compute[75621]:       <mac address="fa:16:3e:91:f1:17"/>
Nov 27 23:10:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:10:38 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:10:38 user nova-compute[75621]:       <target dev="tap93c55381-bf"/>
Nov 27 23:10:38 user nova-compute[75621]:     </interface>
Nov 27 23:10:38 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:10:38 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/console.log" append="off"/>
Nov 27 23:10:38 user nova-compute[75621]:     </serial>
Nov 27 23:10:38 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:10:38 user nova-compute[75621]:     <video>
Nov 27 23:10:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:10:38 user nova-compute[75621]:     </video>
Nov 27 23:10:38 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:10:38 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:10:38 user nova-compute[75621]:     </rng>
Nov 27 23:10:38 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:10:38 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:10:38 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:10:38 user nova-compute[75621]:     </memballoon>
Nov 27 23:10:38 user nova-compute[75621]:   </devices>
Nov 27 23:10:38 user nova-compute[75621]: </domain>
Nov 27 23:10:38 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-11995816',display_name='tempest-AttachVolumeNegativeTest-server-11995816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-11995816',id=26,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYlP9gOsQrx15YDeP9yMNpDjcN++cT/seRssNMRres5iTpjUrdaGDDXA36tFADUVlMUOSnrzrU7SHlvY+29XncnkSeS5k86gB7ki9CZJi1XV/rnYSjqzHUGUZEZfvhOvg==',key_name='tempest-keypair-1495962700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-pxct34bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=144ce759-4144-4606-8a2d-90034d7f9129,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG os_vif [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62c8b293-f9a3-56de-a6f1-70a6693b032a', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93c55381-bf, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93c55381-bf, col_values=(('qos', UUID('6c4e67fd-fb81-4311-b336-25a59115fc88')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93c55381-bf, col_values=(('external_ids', {'iface-id': '93c55381-bfcc-436d-aa32-9a0f4ee3e6f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:f1:17', 'vm-uuid': '144ce759-4144-4606-8a2d-90034d7f9129'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:38 user nova-compute[75621]: INFO os_vif [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf')
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:91:f1:17, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updated VIF entry in instance network info cache for port 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updating instance_info_cache with network_info: [{"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-16b17c41-7ff4-45d5-8523-e4c0a3959af1 req-dbbaf9dc-0054-4a6b-b253-f9a87ea42673 service nova] Releasing lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:10:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] No waiting events found dispatching network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:40 user nova-compute[75621]: WARNING nova.compute.manager [req-b9f34bd2-249c-4e68-8105-b71ac3204ddb req-84b98abe-3937-45fc-8e06-74a87f37d98f service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received unexpected event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 for instance with vm_state building and task_state spawning.
Nov 27 23:10:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:10:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:10:41 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Instance spawned successfully.
Nov 27 23:10:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] No waiting events found dispatching network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:42 user nova-compute[75621]: WARNING nova.compute.manager [req-7a6053b4-01b4-4da9-9546-7aec93f2e809 req-6a9291fc-655f-4dc1-a414-050996a212c5 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received unexpected event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 for instance with vm_state building and task_state spawning.
Nov 27 23:10:42 user nova-compute[75621]: INFO nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 27 23:10:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:10:42 user nova-compute[75621]: INFO nova.compute.manager [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Took 6.22 seconds to build instance.
Nov 27 23:10:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-72acd49d-3ad9-4afd-b549-1b3b1dff5647 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.318s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:46 user nova-compute[75621]: INFO nova.compute.manager [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Terminating instance
Nov 27 23:10:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-318c21f7-0778-4d0a-9670-7021862954d6 req-b4ccefd4-e139-456c-9602-db713ed022b2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-unplugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:10:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Instance destroyed successfully.
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'resources' on Instance uuid b04a6cd0-3193-4b86-8563-1d889000e76e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1291519920',display_name='tempest-AttachVolumeTestJSON-server-1291519920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1291519920',id=4,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJExz+iZf6ruS03B0ZdndDqfz5WP5DtKD4t/rPTAe5KpuLyOaAxgEYyzsC4VRhyS7p2FXybfTLE2S/gIXlsRaH7Ilkm6ZmHNhwkjhbXW8qwIaw7lo1utJMgmBt22yWJKg==',key_name='tempest-keypair-663093508',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-r9pt0onz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:09:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=b04a6cd0-3193-4b86-8563-1d889000e76e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "address": "fa:16:3e:0e:a3:79", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1b9f496e-43", "ovs_interfaceid": "1b9f496e-4328-4bc8-9744-d6e3d2c3df4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG os_vif [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1b9f496e-43, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bc9cd13-68fc-41d0-b9cb-ed90913d980f) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:47 user nova-compute[75621]: INFO os_vif [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a3:79,bridge_name='br-int',has_traffic_filtering=True,id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1b9f496e-43')
Nov 27 23:10:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Deleting instance files /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e_del
Nov 27 23:10:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Deletion of /opt/stack/data/nova/instances/b04a6cd0-3193-4b86-8563-1d889000e76e_del complete
Nov 27 23:10:47 user nova-compute[75621]: INFO nova.compute.manager [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:48 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Took 0.80 seconds to deallocate network for instance.
Nov 27 23:10:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-34a33417-3849-4f76-932f-9b4e0d869f4f req-e8e465b2-f8d4-4c0a-a40a-b6eb75dbd9f4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-deleted-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:48 user nova-compute[75621]: INFO nova.compute.manager [req-34a33417-3849-4f76-932f-9b4e0d869f4f req-e8e465b2-f8d4-4c0a-a40a-b6eb75dbd9f4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Neutron deleted interface 1b9f496e-4328-4bc8-9744-d6e3d2c3df4f; detaching it from the instance and deleting it from the info cache
Nov 27 23:10:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-34a33417-3849-4f76-932f-9b4e0d869f4f req-e8e465b2-f8d4-4c0a-a40a-b6eb75dbd9f4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-34a33417-3849-4f76-932f-9b4e0d869f4f req-e8e465b2-f8d4-4c0a-a40a-b6eb75dbd9f4 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Detach interface failed, port_id=1b9f496e-4328-4bc8-9744-d6e3d2c3df4f, reason: Instance b04a6cd0-3193-4b86-8563-1d889000e76e could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:49 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Deleted allocations for instance b04a6cd0-3193-4b86-8563-1d889000e76e
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ba820dba-ba4e-453e-8ae0-bbc15c968dcf tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] Acquiring lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] Lock "b04a6cd0-3193-4b86-8563-1d889000e76e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] No waiting events found dispatching network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:10:49 user nova-compute[75621]: WARNING nova.compute.manager [req-f47aff80-7396-45f6-97ce-8f5429dac938 req-7fd51339-3043-4a3f-8a07-922f4cbcd4f2 service nova] [instance: b04a6cd0-3193-4b86-8563-1d889000e76e] Received unexpected event network-vif-plugged-1b9f496e-4328-4bc8-9744-d6e3d2c3df4f for instance with vm_state deleted and task_state None.
Nov 27 23:10:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 is timed out.
Nov 27 23:10:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully detached device vdb from instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 from the live domain config.
Nov 27 23:10:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqwrbXoj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:10:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a5e853-3009-401f-8ca5-288af183be05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:10:50 user nova-compute[75621]: No targets found.
Nov 27 23:10:50 user nova-compute[75621]: iSNS:
Nov 27 23:10:50 user nova-compute[75621]: No targets found.
Nov 27 23:10:50 user nova-compute[75621]: STATIC:
Nov 27 23:10:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:10:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455
Nov 27 23:10:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:10:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8
Nov 27 23:10:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:50 user nova-compute[75621]: FIRMWARE:
Nov 27 23:10:50 user nova-compute[75621]: No targets found.
Nov 27 23:10:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:10:50 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:10:50 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dac6088-3952-413e-a401-9d5bff7cde62]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6267d55-07fe-4550-8b68-5433d2ce2750]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:50 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130018e200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4be24fe-08a2-40b1-ad5b-008513f3950f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c00f1b-c6f4-4e09-8e5f-eb3bf96b5147]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cf5273-778e-45eb-a14f-b0b01c750f6c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1d60fa-357c-40b5-aae3-d08e26a6c10b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e197847-2efe-46a3-a69b-1e2cca01ed5e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8f687b-08fc-4e20-b46f-3819cf75f975]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260]
Nov 27 23:10:50 user nova-compute[75621]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8, portal: 172.16.0.220,3260] successful.
Nov 27 23:10:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634f1eed-4134-42fb-9fe4-2dc7e46496a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384cfaa-925e-4fd7-b573-59b2218af6af]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== disconnect_volume: return (327ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:10:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36581020-7dbe-48d5-ba8f-0300d584f0d8 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.776s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:54 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:10:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:10:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:10:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:55 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 is timed out.
Nov 27 23:10:58 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config.
Nov 27 23:10:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uRFPnHDQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:10:58 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb245440-5629-444b-b486-73bbdc06d44e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:10:58 user nova-compute[75621]: No targets found.
Nov 27 23:10:58 user nova-compute[75621]: iSNS:
Nov 27 23:10:58 user nova-compute[75621]: No targets found.
Nov 27 23:10:58 user nova-compute[75621]: STATIC:
Nov 27 23:10:58 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:10:58 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:58 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:58 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455
Nov 27 23:10:58 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:58 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:58 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:10:58 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:10:58 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:10:58 user nova-compute[75621]: FIRMWARE:
Nov 27 23:10:58 user nova-compute[75621]: No targets found.
Nov 27 23:10:58 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:10:58 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:10:58 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cc1c11-bf87-4a51-8c68-02fe60f712df]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da57854-2b25-4c1b-8d18-2f58c7608d43]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:58 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:58 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:58 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:10:58 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:10:58 user nova-compute[75621]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 (non-flash)
Nov 27 23:10:58 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0684d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6819fe5-e7b3-4059-8cd0-d27aaf90412d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eef465-ff12-474f-8c3d-bb7a89a6b979]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8240d2c-453b-4785-ab89-61be47adebe8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bf4157-4a2b-4301-8ca4-adf423688734]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513d13e-7d80-40d0-8c71-b31e495b8fb5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1547bd55-1889-435d-b59e-14a6d0b3fcae]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260]
Nov 27 23:10:58 user nova-compute[75621]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455, portal: 172.16.0.220,3260] successful.
Nov 27 23:10:58 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbf0a068-6eff-483b-a0a3-37b00aad9455 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f34c5f4-4b33-49be-8d80-8f3ed5e8c1ba]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== disconnect_volume: return (379ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ac879c1b-8cf0-45de-b63f-e69605b24273 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:10:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:00 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7287MB free_disk=24.873252868652344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:11:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:11:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:11:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:11:20 user nova-compute[75621]: INFO nova.compute.manager [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] instance snapshotting
Nov 27 23:11:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Beginning live snapshot process
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530.delta 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530.delta 1073741824" returned: 0 in 0.048s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 23:11:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:11:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 20381696 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:11:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:11:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 23:11:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:22 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:11:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530.delta /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530.delta /opt/stack/data/nova/instances/snapshots/tmp2w6hmdr7/09efb7c409764fe59b8cf751b284d530" returned: 0 in 0.548s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:23 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Snapshot extracted, beginning image upload
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:23 user nova-compute[75621]: INFO nova.compute.manager [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Terminating instance
Nov 27 23:11:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-c7207971-9a62-48de-8b1e-bf1f1eda8206 req-b418ef53-fd19-47c8-bbf2-cbcb4a4da040 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-unplugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Instance destroyed successfully.
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'resources' on Instance uuid 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:06:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1880807968',display_name='tempest-TestMinimumBasicScenario-server-1880807968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1880807968',id=19,image_ref='6b169800-4748-4605-a719-b42ec98e471d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHoe847OJZZkfdzCqDNwT1GKCfpIJCgVSaRmavQvQoBaTjDkylEL/RN9U1gLG30z52+OxNlt6aY3DlpeYsfh5BtiSowBM5pYnnQV5NLxI8Hf3DjcF9LnTIQpObX46YGE/g==',key_name='tempest-TestMinimumBasicScenario-1921187105',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:06:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-lnen3ilf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6b169800-4748-4605-a719-b42ec98e471d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:08:43Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=68e5429b-9bdf-4f71-8a6b-fd446c8a08a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "address": "fa:16:3e:53:e7:12", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80fb97ee-75", "ovs_interfaceid": "80fb97ee-75ec-475b-86f0-78e09f6c177b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG os_vif [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80fb97ee-75, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ec8a0416-c886-4913-8221-c0cc8f1250ae) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:24 user nova-compute[75621]: INFO os_vif [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:e7:12,bridge_name='br-int',has_traffic_filtering=True,id=80fb97ee-75ec-475b-86f0-78e09f6c177b,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80fb97ee-75')
Nov 27 23:11:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Deleting instance files /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2_del
Nov 27 23:11:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Deletion of /opt/stack/data/nova/instances/68e5429b-9bdf-4f71-8a6b-fd446c8a08a2_del complete
Nov 27 23:11:24 user nova-compute[75621]: INFO nova.compute.manager [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 23:11:24 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:24 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Took 0.49 seconds to deallocate network for instance.
Nov 27 23:11:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:25 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Deleted allocations for instance 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2
Nov 27 23:11:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcb9b935-651c-4757-aef5-4e04e76fdf07 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.909s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:25 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Snapshot image upload complete
Nov 27 23:11:25 user nova-compute[75621]: INFO nova.compute.manager [None req-ffa44048-969f-4f14-9178-46a86d1525f0 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Took 5.73 seconds to snapshot the instance on the hypervisor.
Nov 27 23:11:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] Acquiring lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] Lock "68e5429b-9bdf-4f71-8a6b-fd446c8a08a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] No waiting events found dispatching network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:25 user nova-compute[75621]: WARNING nova.compute.manager [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received unexpected event network-vif-plugged-80fb97ee-75ec-475b-86f0-78e09f6c177b for instance with vm_state deleted and task_state None.
Nov 27 23:11:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-877a3537-1ed0-4adb-82ea-301531497d65 req-9dd59825-5edd-4592-b49c-65f1bd08daa1 service nova] [instance: 68e5429b-9bdf-4f71-8a6b-fd446c8a08a2] Received event network-vif-deleted-80fb97ee-75ec-475b-86f0-78e09f6c177b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:28 user nova-compute[75621]: INFO nova.compute.manager [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Unshelving
Nov 27 23:11:28 user nova-compute[75621]: INFO nova.virt.block_device [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Booting with volume a84cb56c-a0b6-4192-854d-06fc96c1a778 at /dev/vdc
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.utils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7887be02-60d8-4fc2-a5f5-1ac44afbb245]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236e7c9-b6b7-450b-a903-719db5507889]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3f16e0-2627-49c5-92eb-b41b82962aca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[25678b0d-5464-4d0a-8a3b-2f5ba461012a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:11:28 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:11:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[533af90a-43ac-46b9-8c45-be16264b4242]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG os_brick.utils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:11:28 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating existing volume attachment record: eed4353f-682b-49d0-a4d2-7d4f06a7675c {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:11:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG nova.objects.instance [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:31 user nova-compute[75621]: INFO nova.compute.manager [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attaching volume bbfd0caa-c4c9-4b87-b457-629d4447f9cc to /dev/vdb
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.utils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f1d035-b84c-4a11-b983-8a8a623487ce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f531b4-2e17-438a-ad8e-5be7d060b5e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dc4184-0c76-48d2-a536-8419d9f6e682]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa712d-3c23-4de5-804f-30a34de8e8ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:11:31 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:11:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58ec1fd-c2d0-4bcc-a37a-cca8c8cece13]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG os_brick.utils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:11:31 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating existing volume attachment record: 3aebe5ff-bced-4377-9855-f514c83977a8 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:11:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_requests' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'numa_topology' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:11:35 user nova-compute[75621]: INFO nova.compute.claims [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Claim successful on node user
Nov 27 23:11:35 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:11:35 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:36 user nova-compute[75621]: INFO nova.network.neutron [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating port ad192969-9c6d-4db8-b6cb-02f7ca696616 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing instance network info cache due to event network-changed-ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:11:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] Acquiring lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:11:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Creating image(s)
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'trusted_certs' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] Acquired lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Refreshing network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG nova.objects.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<993ba2a7-2dc0-46f2-8fff-45395e01e340> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "8754a5de270399fe7b68da276234f4b43944f273" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "8754a5de270399fe7b68da276234f4b43944f273" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUqeQzpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:11:38 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:11:38 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:11:38 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15e1c8-b627-41a9-a3a6-183f44a7b972]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:11:38 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.part --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG nova.virt.images [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] 5bd07699-0653-45f9-a79a-331e61adb67a was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.part /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91275b6d-670f-494a-8fdd-c623bfe9f202]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc] added
Nov 27 23:11:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7344780-2836-4403-a294-a30402fc9d59]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad9dec-959f-4d39-8125-7f72e634cca1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUqeQzpZ {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUqeQzpZ" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1e2e4b-faa7-4528-9cb5-b714b0a55d45]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUqeQzpZ'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffe0676-1c41-4239-a1eb-9b3dc5838a73]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updated VIF entry in instance network info cache for port ad192969-9c6d-4db8-b6cb-02f7ca696616. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.part /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.converted" returned: 0 in 0.286s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.146s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78325774-b7ed-49f3-81b9-beeef99a58ea]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:38 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:38 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98acd363-ddf1-4535-a6a2-a3e31e92e8a2 req-b676d945-d3bf-49f4-8254-9eb37c4a551d service nova] Releasing lock "refresh_cache-993ba2a7-2dc0-46f2-8fff-45395e01e340" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "8754a5de270399fe7b68da276234f4b43944f273" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.436s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "8754a5de270399fe7b68da276234f4b43944f273" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "8754a5de270399fe7b68da276234f4b43944f273" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273,backing_fmt=raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273,backing_fmt=raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk 1073741824" returned: 0 in 0.048s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "8754a5de270399fe7b68da276234f4b43944f273" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'migration_context' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG nova.objects.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<993ba2a7-2dc0-46f2-8fff-45395e01e340> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:11:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Rebasing disk image.
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f -F raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --login" returned: 0 in 1.064s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e96c6ef-efec-446a-aad1-6c7bcc2da727]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260]
Nov 27 23:11:39 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260] successful.
Nov 27 23:11:39 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca40956-b838-4e09-ba3b-876085372777]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54a8889-1738-4ddc-877b-f36e4d482f05]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:39 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:39 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:39 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:39 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:39 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:39 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.522s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6c62d9-5633-461e-967a-14396740f81d]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:11:39 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUqeQzpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:11:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.555s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:11:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== connect_volume: return (2558ms) {'type': 'block', 'scsi_wwn': '26663376662373935', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:11:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663376662373935', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:11:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:11:40 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:11:40 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:11:40 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:11:40 user nova-compute[75621]:   <serial>bbfd0caa-c4c9-4b87-b457-629d4447f9cc</serial>
Nov 27 23:11:40 user nova-compute[75621]: </disk>
Nov 27 23:11:40 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No VIF found with MAC fa:16:3e:59:85:77, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-adcaef5b-81a4-4427-8749-039a4c572b6e tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.167s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f -F raw /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk" returned: 0 in 2.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Ensure instance console log exists: /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start _get_guest_xml network_info=[{"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='0d94462a1fd325522ec229a1b854bf3e',container_format='bare',created_at=2023-11-27T23:09:35Z,direct_url=<?>,disk_format='qcow2',id=5bd07699-0653-45f9-a79a-331e61adb67a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1967555061-shelved',owner='37829e68e182457e8df131abcebd5606',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T23:09:39Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'eed4353f-682b-49d0-a4d2-7d4f06a7675c', 'delete_on_termination': False, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzirIsEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '993ba2a7-2dc0-46f2-8fff-45395e01e340', 'attached_at': '', 'detached_at': '', 'volume_id': 'a84cb56c-a0b6-4192-854d-06fc96c1a778', 'serial': 'a84cb56c-a0b6-4192-854d-06fc96c1a778'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:11:41 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:41 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0d94462a1fd325522ec229a1b854bf3e',container_format='bare',created_at=2023-11-27T23:09:35Z,direct_url=<?>,disk_format='qcow2',id=5bd07699-0653-45f9-a79a-331e61adb67a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1967555061-shelved',owner='37829e68e182457e8df131abcebd5606',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T23:09:39Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'vcpu_model' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:11:41 user nova-compute[75621]: INFO nova.compute.claims [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Claim successful on node user
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.objects.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<993ba2a7-2dc0-46f2-8fff-45395e01e340> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzirIsEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:11:41 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:11:41 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:11:41 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260" returned: 21 in 0.180s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c63b963-28a7-46c5-ad90-1e5343a65db8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:11:41 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7607a593-d590-4f5e-a6c3-3d2db7f46db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778] added
Nov 27 23:11:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1642c45-20e8-41d2-9094-3e11a0a096b3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03dc764-e749-4ad2-b323-49b296044f78]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzirIsEn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VzirIsEn" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf52e8-0256-4d8e-9695-7eff42169800]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VzirIsEn'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9750a8c-6d24-49b4-bb51-957a83c1b1bf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef2dfe-de7e-481e-afda-ef662a2fc2f3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d49d9bc-1137-4681-bd88-708a1cd17c00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260]
Nov 27 23:11:42 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260] successful.
Nov 27 23:11:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9806046-4518-4b32-beaf-b77af8619fbe]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b589f764-09cc-4e6c-ad33-bd41c0ea8ccd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:11:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:11:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.456s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] HCTL ('36', '-', '-', 0) found on session 32 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ae76ee-f915-45fb-9570-2abf231481ea]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching for a device in session 32 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzirIsEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:11:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.policy [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc5cf604fbfd4f1dbdbe80b05f540425', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea584e6a3e6b441d8fdec3f91a1c23ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:11:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Creating image(s)
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "/opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "/opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "/opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk 1073741824" returned: 0 in 0.056s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking if we can resize image /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Successfully created port: e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.493s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '26232353839333438', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232353839333438', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='5bd07699-0653-45f9-a79a-331e61adb67a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-131461733',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:09:39.594356',shelved_host='user',shelved_image_id='5bd07699-0653-45f9-a79a-331e61adb67a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_devices' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.objects.base [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<993ba2a7-2dc0-46f2-8fff-45395e01e340> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:11:43 user nova-compute[75621]:   <uuid>993ba2a7-2dc0-46f2-8fff-45395e01e340</uuid>
Nov 27 23:11:43 user nova-compute[75621]:   <name>instance-00000016</name>
Nov 27 23:11:43 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:11:43 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:11:43 user nova-compute[75621]:   <metadata>
Nov 27 23:11:43 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:11:43 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1967555061</nova:name>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:11:41</nova:creationTime>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:11:43 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:11:43 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:owner>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:user uuid="5427c1c08da34bfead47d98f813db775">tempest-AttachVolumeShelveTestJSON-355781585-project-member</nova:user>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:project uuid="37829e68e182457e8df131abcebd5606">tempest-AttachVolumeShelveTestJSON-355781585</nova:project>
Nov 27 23:11:43 user nova-compute[75621]:       </nova:owner>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:root type="image" uuid="5bd07699-0653-45f9-a79a-331e61adb67a"/>
Nov 27 23:11:43 user nova-compute[75621]:       <nova:ports>
Nov 27 23:11:43 user nova-compute[75621]:         <nova:port uuid="ad192969-9c6d-4db8-b6cb-02f7ca696616">
Nov 27 23:11:43 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 23:11:43 user nova-compute[75621]:         </nova:port>
Nov 27 23:11:43 user nova-compute[75621]:       </nova:ports>
Nov 27 23:11:43 user nova-compute[75621]:     </nova:instance>
Nov 27 23:11:43 user nova-compute[75621]:   </metadata>
Nov 27 23:11:43 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:11:43 user nova-compute[75621]:     <system>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="serial">993ba2a7-2dc0-46f2-8fff-45395e01e340</entry>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="uuid">993ba2a7-2dc0-46f2-8fff-45395e01e340</entry>
Nov 27 23:11:43 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:11:43 user nova-compute[75621]:     </system>
Nov 27 23:11:43 user nova-compute[75621]:   </sysinfo>
Nov 27 23:11:43 user nova-compute[75621]:   <os>
Nov 27 23:11:43 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:11:43 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:11:43 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:11:43 user nova-compute[75621]:   </os>
Nov 27 23:11:43 user nova-compute[75621]:   <features>
Nov 27 23:11:43 user nova-compute[75621]:     <acpi/>
Nov 27 23:11:43 user nova-compute[75621]:     <apic/>
Nov 27 23:11:43 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:11:43 user nova-compute[75621]:   </features>
Nov 27 23:11:43 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:11:43 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:11:43 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:11:43 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:11:43 user nova-compute[75621]:   </clock>
Nov 27 23:11:43 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:11:43 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:11:43 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:11:43 user nova-compute[75621]:   </cpu>
Nov 27 23:11:43 user nova-compute[75621]:   <devices>
Nov 27 23:11:43 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:11:43 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:11:43 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk"/>
Nov 27 23:11:43 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:     </disk>
Nov 27 23:11:43 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:11:43 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:11:43 user nova-compute[75621]:       <source dev="/dev/sde"/>
Nov 27 23:11:43 user nova-compute[75621]:       <target dev="vdc" bus="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:       <serial>a84cb56c-a0b6-4192-854d-06fc96c1a778</serial>
Nov 27 23:11:43 user nova-compute[75621]:     </disk>
Nov 27 23:11:43 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:11:43 user nova-compute[75621]:       <mac address="fa:16:3e:51:7f:cd"/>
Nov 27 23:11:43 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:11:43 user nova-compute[75621]:       <target dev="tapad192969-9c"/>
Nov 27 23:11:43 user nova-compute[75621]:     </interface>
Nov 27 23:11:43 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:11:43 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/console.log" append="off"/>
Nov 27 23:11:43 user nova-compute[75621]:     </serial>
Nov 27 23:11:43 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:11:43 user nova-compute[75621]:     <video>
Nov 27 23:11:43 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:     </video>
Nov 27 23:11:43 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:11:43 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:11:43 user nova-compute[75621]:     </rng>
Nov 27 23:11:43 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:11:43 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:11:43 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:11:43 user nova-compute[75621]:     </memballoon>
Nov 27 23:11:43 user nova-compute[75621]:   </devices>
Nov 27 23:11:43 user nova-compute[75621]: </domain>
Nov 27 23:11:43 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='5bd07699-0653-45f9-a79a-331e61adb67a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-131461733',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:09:39.594356',shelved_host='user',shelved_image_id='5bd07699-0653-45f9-a79a-331e61adb67a'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:11:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG os_vif [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf040b39-bdad-5934-8261-f7e285cafb03', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Cannot resize image /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Ensure instance console log exists: /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapad192969-9c, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapad192969-9c, col_values=(('qos', UUID('491844ac-6f54-4ae5-a567-4e96bca78aa1')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapad192969-9c, col_values=(('external_ids', {'iface-id': 'ad192969-9c6d-4db8-b6cb-02f7ca696616', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:7f:cd', 'vm-uuid': '993ba2a7-2dc0-46f2-8fff-45395e01e340'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: INFO os_vif [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c')
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No VIF found with MAC fa:16:3e:51:7f:cd, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:43 user nova-compute[75621]: INFO nova.compute.manager [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Detaching volume bbfd0caa-c4c9-4b87-b457-629d4447f9cc
Nov 27 23:11:43 user nova-compute[75621]: INFO nova.virt.block_device [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attempting to driver detach volume bbfd0caa-c4c9-4b87-b457-629d4447f9cc from mountpoint /dev/vdb
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Attempting to detach device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:11:43 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:11:43 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:11:43 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:   <serial>bbfd0caa-c4c9-4b87-b457-629d4447f9cc</serial>
Nov 27 23:11:43 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:11:43 user nova-compute[75621]: </disk>
Nov 27 23:11:43 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:11:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config.
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:11:43 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:11:43 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:11:43 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:11:43 user nova-compute[75621]:   <serial>bbfd0caa-c4c9-4b87-b457-629d4447f9cc</serial>
Nov 27 23:11:43 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:11:43 user nova-compute[75621]: </disk>
Nov 27 23:11:43 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Successfully updated port: e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquired lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-changed-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Refreshing instance network info cache due to event network-changed-e449eb71-f371-4604-afd1-e19f0c9cc7e8. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] Acquiring lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:11:44 user nova-compute[75621]: INFO nova.compute.manager [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Unrescuing
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating instance_info_cache with network_info: [{"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Releasing lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Instance network_info: |[{"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] Acquired lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Refreshing network info cache for port e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Start _get_guest_xml network_info=[{"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:11:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-273773289',display_name='tempest-AttachVolumeTestJSON-server-273773289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-273773289',id=27,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkznY3LvKpvwmI8ktCuxS/qaPcZv9Ia3g8H9XGhmuJJjFHbrd83dRF+mx2eKytCTXaWbWYiCKHIqJBuvIVxL5ZXf5JhxVafdK6AJulQvBFONzrPrI2tn/x0DbwvMU72zA==',key_name='tempest-keypair-435421617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-wfv7y97s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=de02eaf0-a5ee-4514-8ccd-53e92766ee05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'pci_devices' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:11:44 user nova-compute[75621]:   <uuid>de02eaf0-a5ee-4514-8ccd-53e92766ee05</uuid>
Nov 27 23:11:44 user nova-compute[75621]:   <name>instance-0000001b</name>
Nov 27 23:11:44 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:11:44 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:11:44 user nova-compute[75621]:   <metadata>
Nov 27 23:11:44 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:11:44 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeTestJSON-server-273773289</nova:name>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:11:44</nova:creationTime>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:11:44 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:11:44 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:owner>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:user uuid="cc5cf604fbfd4f1dbdbe80b05f540425">tempest-AttachVolumeTestJSON-1955560544-project-member</nova:user>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:project uuid="ea584e6a3e6b441d8fdec3f91a1c23ed">tempest-AttachVolumeTestJSON-1955560544</nova:project>
Nov 27 23:11:44 user nova-compute[75621]:       </nova:owner>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:11:44 user nova-compute[75621]:       <nova:ports>
Nov 27 23:11:44 user nova-compute[75621]:         <nova:port uuid="e449eb71-f371-4604-afd1-e19f0c9cc7e8">
Nov 27 23:11:44 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 23:11:44 user nova-compute[75621]:         </nova:port>
Nov 27 23:11:44 user nova-compute[75621]:       </nova:ports>
Nov 27 23:11:44 user nova-compute[75621]:     </nova:instance>
Nov 27 23:11:44 user nova-compute[75621]:   </metadata>
Nov 27 23:11:44 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:11:44 user nova-compute[75621]:     <system>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="serial">de02eaf0-a5ee-4514-8ccd-53e92766ee05</entry>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="uuid">de02eaf0-a5ee-4514-8ccd-53e92766ee05</entry>
Nov 27 23:11:44 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:11:44 user nova-compute[75621]:     </system>
Nov 27 23:11:44 user nova-compute[75621]:   </sysinfo>
Nov 27 23:11:44 user nova-compute[75621]:   <os>
Nov 27 23:11:44 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:11:44 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:11:44 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:11:44 user nova-compute[75621]:   </os>
Nov 27 23:11:44 user nova-compute[75621]:   <features>
Nov 27 23:11:44 user nova-compute[75621]:     <acpi/>
Nov 27 23:11:44 user nova-compute[75621]:     <apic/>
Nov 27 23:11:44 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:11:44 user nova-compute[75621]:   </features>
Nov 27 23:11:44 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:11:44 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:11:44 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:11:44 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:11:44 user nova-compute[75621]:   </clock>
Nov 27 23:11:44 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:11:44 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:11:44 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:11:44 user nova-compute[75621]:   </cpu>
Nov 27 23:11:44 user nova-compute[75621]:   <devices>
Nov 27 23:11:44 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:11:44 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:11:44 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk"/>
Nov 27 23:11:44 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:11:44 user nova-compute[75621]:     </disk>
Nov 27 23:11:44 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:11:44 user nova-compute[75621]:       <mac address="fa:16:3e:42:1a:5f"/>
Nov 27 23:11:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:11:44 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:11:44 user nova-compute[75621]:       <target dev="tape449eb71-f3"/>
Nov 27 23:11:44 user nova-compute[75621]:     </interface>
Nov 27 23:11:44 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:11:44 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/console.log" append="off"/>
Nov 27 23:11:44 user nova-compute[75621]:     </serial>
Nov 27 23:11:44 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:11:44 user nova-compute[75621]:     <video>
Nov 27 23:11:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:11:44 user nova-compute[75621]:     </video>
Nov 27 23:11:44 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:11:44 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:11:44 user nova-compute[75621]:     </rng>
Nov 27 23:11:44 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:11:44 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:11:44 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:11:44 user nova-compute[75621]:     </memballoon>
Nov 27 23:11:44 user nova-compute[75621]:   </devices>
Nov 27 23:11:44 user nova-compute[75621]: </domain>
Nov 27 23:11:44 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-273773289',display_name='tempest-AttachVolumeTestJSON-server-273773289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-273773289',id=27,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkznY3LvKpvwmI8ktCuxS/qaPcZv9Ia3g8H9XGhmuJJjFHbrd83dRF+mx2eKytCTXaWbWYiCKHIqJBuvIVxL5ZXf5JhxVafdK6AJulQvBFONzrPrI2tn/x0DbwvMU72zA==',key_name='tempest-keypair-435421617',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-wfv7y97s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=de02eaf0-a5ee-4514-8ccd-53e92766ee05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG os_vif [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f98be44f-0b84-5093-a86c-0a649a4609f0', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape449eb71-f3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape449eb71-f3, col_values=(('qos', UUID('3d35445b-56ed-4c35-9f95-f595d44317c7')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape449eb71-f3, col_values=(('external_ids', {'iface-id': 'e449eb71-f371-4604-afd1-e19f0c9cc7e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:1a:5f', 'vm-uuid': 'de02eaf0-a5ee-4514-8ccd-53e92766ee05'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: INFO os_vif [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3')
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No VIF found with MAC fa:16:3e:42:1a:5f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'flavor' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updated VIF entry in instance network info cache for port e449eb71-f371-4604-afd1-e19f0c9cc7e8. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating instance_info_cache with network_info: [{"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61208940-0449-45bd-aa83-1859581c710f req-69537ead-1ab6-450d-935a-5beff0bcdbf8 service nova] Releasing lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:45 user nova-compute[75621]: WARNING nova.compute.manager [req-86856a12-31a4-4739-99ac-d4e21c69b9f2 req-48ef3690-59c3-4654-9bb7-a6ca4922b6d3 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:11:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance destroyed successfully.
Nov 27 23:11:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-changed-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing instance network info cache due to event network-changed-41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updated VIF entry in instance network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-changed-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing instance network info cache due to event network-changed-41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquiring lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquired lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Refreshing network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updated VIF entry in instance network info cache for port 41832a48-3bfe-4379-b729-eb69507911ef. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [{"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Releasing lock "refresh_cache-c536051b-9b80-4df7-8903-3b0db3a9050e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:48 user nova-compute[75621]: WARNING nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:48 user nova-compute[75621]: WARNING nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:48 user nova-compute[75621]: WARNING nova.compute.manager [req-e3c5367a-6959-4b38-a1d2-5b6a5b6512cb req-da75362d-f82b-454f-870b-546f65011f46 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] No waiting events found dispatching network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:48 user nova-compute[75621]: WARNING nova.compute.manager [req-b5e63187-ba2b-4270-a320-09f317cb2121 req-b8dcbfa5-2de5-4e87-b0c8-f98913698a9f service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received unexpected event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 for instance with vm_state building and task_state spawning.
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:49 user nova-compute[75621]: WARNING nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:11:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:49 user nova-compute[75621]: WARNING nova.compute.manager [req-294d4a28-6a46-48d4-a68b-efe25a9855ae req-b0212a8c-d83d-4caf-8f89-8e3ae3b0ed7c service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:11:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] No waiting events found dispatching network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:11:50 user nova-compute[75621]: WARNING nova.compute.manager [req-febb8027-bef4-4d58-ad1b-9ec686e5dccc req-5ec6043b-b7c0-4b7e-ad5a-ed733ed28288 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received unexpected event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 for instance with vm_state building and task_state spawning.
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:11:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance spawned successfully.
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:11:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Instance spawned successfully.
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e6020949-86b1-43ac-8c78-e983ea4b37b3 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:11:50 user nova-compute[75621]: INFO nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Took 8.24 seconds to spawn the instance on the hypervisor.
Nov 27 23:11:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a15e10ef-a923-48ae-9103-767f11a76d46 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.676s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:50 user nova-compute[75621]: INFO nova.compute.manager [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Took 9.13 seconds to build instance.
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aa45b26d-4828-4ee6-9955-a8235c030163 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.248s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:11:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:11:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:11:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7620MB free_disk=24.822086334228516GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:12:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.798s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:12:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:04 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 is timed out.
Nov 27 23:12:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config.
Nov 27 23:12:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUqeQzpZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:04 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a25b8b-cfad-4ad0-85a2-fe0e482d1823]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:12:04 user nova-compute[75621]: No targets found.
Nov 27 23:12:04 user nova-compute[75621]: iSNS:
Nov 27 23:12:04 user nova-compute[75621]: No targets found.
Nov 27 23:12:04 user nova-compute[75621]: STATIC:
Nov 27 23:12:04 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc
Nov 27 23:12:04 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:04 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:04 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:12:04 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:04 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:04 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:12:04 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:04 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:04 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778
Nov 27 23:12:04 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:04 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:04 user nova-compute[75621]: FIRMWARE:
Nov 27 23:12:04 user nova-compute[75621]: No targets found.
Nov 27 23:12:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:12:04 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:12:04 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e539021f-12a3-4fa4-8d4e-5aff66ba24f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[986974ba-ffb0-4b03-a0ad-39c9cd197819]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc (non-flash)
Nov 27 23:12:04 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07f5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e81469a-6895-4465-8539-55e719892125]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1b3d12-8128-4eec-a848-04198dbb3d10]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6345a8-eef8-471b-939f-9bffdc020bd8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[039348ab-a85c-455c-95a5-9df7a6b90c40]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7562b31f-f2bb-449e-a39c-c6330b7f95b5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a290fa-4eee-4f19-bde0-dcd9840b85b4]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260]
Nov 27 23:12:04 user nova-compute[75621]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfd0caa-c4c9-4b87-b457-629d4447f9cc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15b1206-2a4d-4dd2-add3-6a9150b28c10]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== disconnect_volume: return (308ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG nova.objects.instance [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-481aa16b-d5ec-485f-816b-1841ae0a06b0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.065s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [{"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b75ec495-38b4-42ff-a489-13b76129b094" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:12:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:17 user nova-compute[75621]: INFO nova.compute.manager [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Detaching volume baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:12:17 user nova-compute[75621]: INFO nova.virt.block_device [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Attempting to driver detach volume baed5c3d-f972-467b-9222-7d23abedba1e from mountpoint /dev/vdb
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Attempting to detach device vdb from instance c536051b-9b80-4df7-8903-3b0db3a9050e from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:12:17 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:17 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:12:17 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:17 user nova-compute[75621]:   <serial>baed5c3d-f972-467b-9222-7d23abedba1e</serial>
Nov 27 23:12:17 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:12:17 user nova-compute[75621]: </disk>
Nov 27 23:12:17 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:12:17 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Successfully detached device vdb from instance c536051b-9b80-4df7-8903-3b0db3a9050e from the persistent domain config.
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c536051b-9b80-4df7-8903-3b0db3a9050e from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:12:17 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:17 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:12:17 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:17 user nova-compute[75621]:   <serial>baed5c3d-f972-467b-9222-7d23abedba1e</serial>
Nov 27 23:12:17 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:12:17 user nova-compute[75621]: </disk>
Nov 27 23:12:17 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:12:17 user nova-compute[75621]: INFO nova.compute.claims [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Claim successful on node user
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:12:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.policy [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22a7b251f7b641e184d1fc8bb44562b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b3b221a362d4bd6b7a057c97513a70b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:12:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Creating image(s)
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "/opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "/opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG nova.virt.images [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] 1595f84a-81a9-4819-84a8-a5ec94e1b17b was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.part /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Successfully created port: 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.part /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.converted" returned: 0 in 0.315s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.203s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Successfully updated port: 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db,backing_fmt=raw /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing instance network info cache due to event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db,backing_fmt=raw /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk 1073741824" returned: 0 in 0.061s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "5cb47fe0f038e53b71e2c50cb253c603364cc2db" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Cannot resize image /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Ensure instance console log exists: /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance network_info: |[{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Start _get_guest_xml network_info=[{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:12:15Z,direct_url=<?>,disk_format='qcow2',id=1595f84a-81a9-4819-84a8-a5ec94e1b17b,min_disk=0,min_ram=0,name='tempest-scenario-img--921673954',owner='9b3b221a362d4bd6b7a057c97513a70b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:12:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '1595f84a-81a9-4819-84a8-a5ec94e1b17b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:12:20 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:20 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T23:12:15Z,direct_url=<?>,disk_format='qcow2',id=1595f84a-81a9-4819-84a8-a5ec94e1b17b,min_disk=0,min_ram=0,name='tempest-scenario-img--921673954',owner='9b3b221a362d4bd6b7a057c97513a70b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T23:12:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230269902',display_name='tempest-TestMinimumBasicScenario-server-230269902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230269902',id=28,image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2RmJzrmEMDAgye2SskpTG/55ZQ6p3CsXMQZU2Pv2H4Ln6Bb9f/fJg/eN2/WrY0bqncoPqf5Lnk0HdtmyqTRIXx7EMCVvzr8UoVwUIvzfdTzwn6GGXGFI4yQz+WxC87Zw==',key_name='tempest-TestMinimumBasicScenario-394531675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-n1q0h8as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:19Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=1a460ee6-8f9c-4973-9046-9ab3c8f6a022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:12:20 user nova-compute[75621]:   <uuid>1a460ee6-8f9c-4973-9046-9ab3c8f6a022</uuid>
Nov 27 23:12:20 user nova-compute[75621]:   <name>instance-0000001c</name>
Nov 27 23:12:20 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:12:20 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:12:20 user nova-compute[75621]:   <metadata>
Nov 27 23:12:20 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:12:20 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:name>tempest-TestMinimumBasicScenario-server-230269902</nova:name>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:12:20</nova:creationTime>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:12:20 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:12:20 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:owner>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:user uuid="22a7b251f7b641e184d1fc8bb44562b9">tempest-TestMinimumBasicScenario-1822102155-project-member</nova:user>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:project uuid="9b3b221a362d4bd6b7a057c97513a70b">tempest-TestMinimumBasicScenario-1822102155</nova:project>
Nov 27 23:12:20 user nova-compute[75621]:       </nova:owner>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:root type="image" uuid="1595f84a-81a9-4819-84a8-a5ec94e1b17b"/>
Nov 27 23:12:20 user nova-compute[75621]:       <nova:ports>
Nov 27 23:12:20 user nova-compute[75621]:         <nova:port uuid="4cb34199-31b4-4cce-b269-7a71b5cd6d77">
Nov 27 23:12:20 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 23:12:20 user nova-compute[75621]:         </nova:port>
Nov 27 23:12:20 user nova-compute[75621]:       </nova:ports>
Nov 27 23:12:20 user nova-compute[75621]:     </nova:instance>
Nov 27 23:12:20 user nova-compute[75621]:   </metadata>
Nov 27 23:12:20 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:12:20 user nova-compute[75621]:     <system>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="serial">1a460ee6-8f9c-4973-9046-9ab3c8f6a022</entry>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="uuid">1a460ee6-8f9c-4973-9046-9ab3c8f6a022</entry>
Nov 27 23:12:20 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:12:20 user nova-compute[75621]:     </system>
Nov 27 23:12:20 user nova-compute[75621]:   </sysinfo>
Nov 27 23:12:20 user nova-compute[75621]:   <os>
Nov 27 23:12:20 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:12:20 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:12:20 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:12:20 user nova-compute[75621]:   </os>
Nov 27 23:12:20 user nova-compute[75621]:   <features>
Nov 27 23:12:20 user nova-compute[75621]:     <acpi/>
Nov 27 23:12:20 user nova-compute[75621]:     <apic/>
Nov 27 23:12:20 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:12:20 user nova-compute[75621]:   </features>
Nov 27 23:12:20 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:12:20 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:12:20 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:12:20 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:12:20 user nova-compute[75621]:   </clock>
Nov 27 23:12:20 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:12:20 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:12:20 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:12:20 user nova-compute[75621]:   </cpu>
Nov 27 23:12:20 user nova-compute[75621]:   <devices>
Nov 27 23:12:20 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:12:20 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:12:20 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk"/>
Nov 27 23:12:20 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:12:20 user nova-compute[75621]:     </disk>
Nov 27 23:12:20 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:12:20 user nova-compute[75621]:       <mac address="fa:16:3e:33:a5:70"/>
Nov 27 23:12:20 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:20 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:12:20 user nova-compute[75621]:       <target dev="tap4cb34199-31"/>
Nov 27 23:12:20 user nova-compute[75621]:     </interface>
Nov 27 23:12:20 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:12:20 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/console.log" append="off"/>
Nov 27 23:12:20 user nova-compute[75621]:     </serial>
Nov 27 23:12:20 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:12:20 user nova-compute[75621]:     <video>
Nov 27 23:12:20 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:20 user nova-compute[75621]:     </video>
Nov 27 23:12:20 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:12:20 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:12:20 user nova-compute[75621]:     </rng>
Nov 27 23:12:20 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:12:20 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:12:20 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:12:20 user nova-compute[75621]:     </memballoon>
Nov 27 23:12:20 user nova-compute[75621]:   </devices>
Nov 27 23:12:20 user nova-compute[75621]: </domain>
Nov 27 23:12:20 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230269902',display_name='tempest-TestMinimumBasicScenario-server-230269902',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230269902',id=28,image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2RmJzrmEMDAgye2SskpTG/55ZQ6p3CsXMQZU2Pv2H4Ln6Bb9f/fJg/eN2/WrY0bqncoPqf5Lnk0HdtmyqTRIXx7EMCVvzr8UoVwUIvzfdTzwn6GGXGFI4yQz+WxC87Zw==',key_name='tempest-TestMinimumBasicScenario-394531675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-n1q0h8as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:19Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=1a460ee6-8f9c-4973-9046-9ab3c8f6a022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG os_vif [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'af68d4dd-d782-5da3-b7ff-c94a9671389e', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cb34199-31, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cb34199-31, col_values=(('qos', UUID('7159cd19-1f4a-46f6-80ba-82ed5ed7ea3d')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cb34199-31, col_values=(('external_ids', {'iface-id': '4cb34199-31b4-4cce-b269-7a71b5cd6d77', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:a5:70', 'vm-uuid': '1a460ee6-8f9c-4973-9046-9ab3c8f6a022'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:20 user nova-compute[75621]: INFO os_vif [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31')
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No VIF found with MAC fa:16:3e:33:a5:70, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updated VIF entry in instance network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:12:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0be255bc-0a93-4f2f-a5bc-8e58fd3881b2 req-aa24f90d-2d2b-4859-8faf-45eb119fcf60 service nova] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:22 user nova-compute[75621]: WARNING nova.compute.manager [req-51e8ccfe-dbe1-4cf0-9024-a3e670222a82 req-8d92d2dc-bb2b-4247-9d8f-0edd9026bf87 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state building and task_state spawning.
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:12:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance spawned successfully.
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:24 user nova-compute[75621]: WARNING nova.compute.manager [req-0808312e-5e8b-4a7f-ad77-46f73d2696b3 req-2f0b9373-94a0-454f-a3f3-d62ddc6ee4de service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state building and task_state spawning.
Nov 27 23:12:24 user nova-compute[75621]: INFO nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 27 23:12:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:12:24 user nova-compute[75621]: INFO nova.compute.manager [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Took 6.55 seconds to build instance.
Nov 27 23:12:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-59aaaea1-c14e-4aee-bb5a-cf7977fe8ee7 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.641s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:25 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:12:25 user nova-compute[75621]: INFO nova.compute.claims [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Claim successful on node user
Nov 27 23:12:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.543s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:12:26 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:12:26 user nova-compute[75621]: INFO nova.virt.block_device [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Booting with volume b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba at /dev/vda
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.policy [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4cbbd5877014527889b23cd592da5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af3c98f53504bd39917790819b9bae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a913d-664c-422e-b7eb-239ffef66444]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32dd191-4e17-4e61-aae7-10a7a419ac87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f94e88d-0ce2-4c84-bdfa-03bc5587684f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[805a7aa8-8350-483e-8d54-ec34b679ffef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:26 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:12:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b001f56d-b52a-4f8d-b2e2-6a3e766db9fc]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:26 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating existing volume attachment record: 5e38472a-fdb3-477b-9d7c-af8cfcb61800 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-changed-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Refreshing instance network info cache due to event network-changed-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] Acquiring lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] Acquired lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG nova.network.neutron [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Refreshing network info cache for port 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:27 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Successfully created port: cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updated VIF entry in instance network info cache for port 93c55381-bfcc-436d-aa32-9a0f4ee3e6f2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updating instance_info_cache with network_info: [{"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b2628de9-1367-4221-9ddf-b159e8fb3842 req-1aca8c7e-3e15-4b3b-b59e-72362aaaf5f2 service nova] Releasing lock "refresh_cache-144ce759-4144-4606-8a2d-90034d7f9129" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:12:29 user nova-compute[75621]: INFO nova.compute.claims [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Claim successful on node user
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Successfully updated port: cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-changed-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Refreshing instance network info cache due to event network-changed-cf6eb519-6256-422e-871e-4dd93ca7711b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance network_info: |[{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Refreshing network info cache for port cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.741s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:12:29 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:12:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:12:29 user nova-compute[75621]: INFO nova.virt.block_device [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Booting with volume-backed-image 6631148d-0ff5-48f2-bd92-4bf6df1a42c4 at /dev/vda
Nov 27 23:12:30 user nova-compute[75621]: DEBUG nova.policy [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '506743bc2ab54538b400595de8792b5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef81acb6ed764a23a83269df20981c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updated VIF entry in instance network info cache for port cf6eb519-6256-422e-871e-4dd93ca7711b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f949e78-3e3b-46dc-bed7-e46ed7848dbc req-0db47ae3-8df4-4332-b578-bab90ce26274 service nova] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Successfully created port: 6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:30 user nova-compute[75621]: INFO nova.compute.manager [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Attaching volume 78e79404-92e4-41a9-be66-cbb127b8164b to /dev/vdb
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.utils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a151c97-7e4a-4260-aacd-70b3133d9267]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[306380f6-4d92-441c-b08d-e0068b64284b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ec749-517a-4ccc-8dcc-6d83f1fbfac5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88435696-e900-4690-b5ef-cf8cb0f3506f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:31 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[242f7186-23e3-4ee8-a9cf-998280e899d5]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG os_brick.utils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updating existing volume attachment record: 2c26c8de-f1a1-4751-923d-6a7d72587474 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Successfully updated port: 6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-changed-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Refreshing instance network info cache due to event network-changed-6bc17f22-a156-4844-8a19-a37664ce1d9e. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] Acquiring lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:12:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance network_info: |[{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] Acquired lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Refreshing network info cache for port 6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updated VIF entry in instance network info cache for port 6bc17f22-a156-4844-8a19-a37664ce1d9e. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-85f325b2-9dcb-48db-8d53-c96d9761cd5b req-61f03284-a3c5-45b3-aa9b-fdbd1ababee6 service nova] Releasing lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.utils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef63901-9222-434e-83ae-4dd1345e177c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e40f46-b9ab-4e59-8f6b-a82cfc0e0e60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5235fb-7984-4fa7-a129-091fb0368a01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[46813624-bab0-45f0-a6e4-8852535e5d44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:35 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:12:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0daea51-b1ba-466e-8f76-dfefb87a2087]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG os_brick.utils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:35 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating existing volume attachment record: c3e6897e-b4af-4166-a588-943696680731 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:12:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c536051b-9b80-4df7-8903-3b0db3a9050e is timed out.
Nov 27 23:12:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Successfully detached device vdb from instance c536051b-9b80-4df7-8903-3b0db3a9050e from the live domain config.
Nov 27 23:12:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hjWmGfJR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[935c8621-4e10-4d31-a54e-0c6ea3e47136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:12:37 user nova-compute[75621]: No targets found.
Nov 27 23:12:37 user nova-compute[75621]: iSNS:
Nov 27 23:12:37 user nova-compute[75621]: No targets found.
Nov 27 23:12:37 user nova-compute[75621]: STATIC:
Nov 27 23:12:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e
Nov 27 23:12:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:12:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778
Nov 27 23:12:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:12:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:12:37 user nova-compute[75621]: FIRMWARE:
Nov 27 23:12:37 user nova-compute[75621]: No targets found.
Nov 27 23:12:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:12:37 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:12:37 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ed328d-4532-4619-8c58-75a907f9b1d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfac5d4-be5c-4458-8c05-3b896cccf275]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:37 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:12:37 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:37 user nova-compute[75621]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e (non-flash)
Nov 27 23:12:37 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e079b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8ea9be-60d6-4026-b149-e407af330f6f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a016c4f-2592-41f5-814f-f03d3a5f1a9b]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3563ad7-a728-418e-be3e-5de26aa85f90]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ced25-84a5-4af5-b358-3bda0c3e77cb]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f419353a-3be6-4a3a-b342-3c2efa02716a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9547d6-6d60-4be1-a29d-cc4c7c40fd50]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260]
Nov 27 23:12:37 user nova-compute[75621]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baed5c3d-f972-467b-9222-7d23abedba1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed330e-3dc7-449a-bb9a-27b1db12678c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] <== disconnect_volume: return (315ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:12:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTBXdcFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:42 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd5246-1981-41b8-9af3-53b124f56121]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:12:42 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f829480-2b47-4a92-874c-07bc6f47905d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b] added
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d568e2d8-a9b4-4a38-818d-920e03be5edc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dd0a80-c2ef-4751-ae95-8f4829d3c880]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTBXdcFf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qTBXdcFf" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc3966-9fd0-4093-9f12-64769cb7e331]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qTBXdcFf'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5268e-5bd3-4738-9eb0-00ab1c241706]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:12:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Creating image(s)
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Ensure instance console log exists: /opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start _get_guest_xml network_info=[{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '5e38472a-fdb3-477b-9d7c-af8cfcb61800', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '203ff896-ed38-4378-9146-075fb92cf657', 'attached_at': '', 'detached_at': '', 'volume_id': 'b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'serial': 'b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:42 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[808332b4-0a93-4245-bec2-78362b9b934f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f06d1a0-2f20-416d-bf7f-6f06ca076f51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260]
Nov 27 23:12:42 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.114s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7983e171-a47a-4be5-8c08-36c072511240]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfe333a-b14d-4eb1-bac2-f4078dd30c73]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:42 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b33155d-b66f-4bb2-9c9e-7e15064c1d7b]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTBXdcFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:42 user nova-compute[75621]: INFO nova.compute.manager [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attaching volume d435bb60-3d69-4840-bc63-7d123b5ec32e to /dev/vdb
Nov 27 23:12:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'flavor' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-efc5e0dc-8573-4980-814b-f32a30aa84de tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.891s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG os_brick.utils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb24bb5-14cc-4047-b64d-8605a39f4127]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[954ae5a2-6ecd-47bf-8fc4-e3954306f300]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd8b9a7-a7f3-4370-bc28-c354e4e6f587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262eb16-b391-4b0c-ab21-907aa0a94ae9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:12:43 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eb1326-b30f-4715-8a90-be0f5774860b]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating existing volume attachment record: 5475b29e-9dd0-4ef6-9f2f-9b48cc480064 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:12:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Creating image(s)
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Ensure instance console log exists: /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start _get_guest_xml network_info=[{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c3e6897e-b4af-4166-a588-943696680731', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '89a23062-cf16-4dd9-b6e8-7483115ca1c3', 'attached_at': '', 'detached_at': '', 'volume_id': '71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'serial': '71cf7f9a-e2e6-455b-8065-0ecde4d24980'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:12:43 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:43 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23637313936393563', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637313936393563', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.205s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:43 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[33643c48-2770-4a17-baca-de0b636710f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:12:43 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:12:43 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:43 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:12:43 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:43 user nova-compute[75621]:   <serial>78e79404-92e4-41a9-be66-cbb127b8164b</serial>
Nov 27 23:12:43 user nova-compute[75621]: </disk>
Nov 27 23:12:43 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6e95d-9406-4bc0-aad9-49fbef87b043]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba] added
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa953f0-808d-4969-beb5-55a12969c4c7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b696836a-44cb-4387-ae2b-d2a2a085af0b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsXpHShg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsXpHShg" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc96c1-0393-4299-b6c3-2854a29d46f0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lsXpHShg'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a957d1-2f18-4605-9d4f-a1fee638e616]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[671499a7-e2d7-49a3-87cb-1472b82ac855]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af26fce8-50de-45a9-a04b-5f3718d253f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]
Nov 27 23:12:43 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c64b82e-e4f7-4149-8a10-fcbd3341ab67]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dde5ea-5e49-4c61-a0c4-e5908b80defc]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a829d5df-4f14-4402-8618-f58537360655]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:91:f1:17, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f276fa21-9274-4e0a-994e-0edf7a143e63 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.083s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== connect_volume: return (2519ms) {'type': 'block', 'scsi_wwn': '23464623432333634', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464623432333634', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.440s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:44 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:44 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'pci_devices' on Instance uuid 203ff896-ed38-4378-9146-075fb92cf657 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[33904094-1ac4-46c4-88c2-90a1af3c04ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:12:44 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:12:44 user nova-compute[75621]:   <uuid>203ff896-ed38-4378-9146-075fb92cf657</uuid>
Nov 27 23:12:44 user nova-compute[75621]:   <name>instance-0000001d</name>
Nov 27 23:12:44 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:12:44 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:12:44 user nova-compute[75621]:   <metadata>
Nov 27 23:12:44 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:12:44 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:12:44 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherA-server-1308485278</nova:name>
Nov 27 23:12:44 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:12:42</nova:creationTime>
Nov 27 23:12:44 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:12:44 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:12:44 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:12:44 user nova-compute[75621]:       <nova:owner>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:user uuid="d4cbbd5877014527889b23cd592da5f0">tempest-ServerActionsTestOtherA-1166847266-project-member</nova:user>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:project uuid="7af3c98f53504bd39917790819b9bae6">tempest-ServerActionsTestOtherA-1166847266</nova:project>
Nov 27 23:12:44 user nova-compute[75621]:       </nova:owner>
Nov 27 23:12:44 user nova-compute[75621]:       <nova:ports>
Nov 27 23:12:44 user nova-compute[75621]:         <nova:port uuid="cf6eb519-6256-422e-871e-4dd93ca7711b">
Nov 27 23:12:44 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:12:44 user nova-compute[75621]:         </nova:port>
Nov 27 23:12:44 user nova-compute[75621]:       </nova:ports>
Nov 27 23:12:44 user nova-compute[75621]:     </nova:instance>
Nov 27 23:12:44 user nova-compute[75621]:   </metadata>
Nov 27 23:12:44 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:12:44 user nova-compute[75621]:     <system>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="serial">203ff896-ed38-4378-9146-075fb92cf657</entry>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="uuid">203ff896-ed38-4378-9146-075fb92cf657</entry>
Nov 27 23:12:44 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:12:44 user nova-compute[75621]:     </system>
Nov 27 23:12:44 user nova-compute[75621]:   </sysinfo>
Nov 27 23:12:44 user nova-compute[75621]:   <os>
Nov 27 23:12:44 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:12:44 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:12:44 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:12:44 user nova-compute[75621]:   </os>
Nov 27 23:12:44 user nova-compute[75621]:   <features>
Nov 27 23:12:44 user nova-compute[75621]:     <acpi/>
Nov 27 23:12:44 user nova-compute[75621]:     <apic/>
Nov 27 23:12:44 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:12:44 user nova-compute[75621]:   </features>
Nov 27 23:12:44 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:12:44 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:12:44 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:12:44 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:12:44 user nova-compute[75621]:   </clock>
Nov 27 23:12:44 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:12:44 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:12:44 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:12:44 user nova-compute[75621]:   </cpu>
Nov 27 23:12:44 user nova-compute[75621]:   <devices>
Nov 27 23:12:44 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:12:44 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:44 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:12:44 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:12:44 user nova-compute[75621]:       <serial>b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba</serial>
Nov 27 23:12:44 user nova-compute[75621]:     </disk>
Nov 27 23:12:44 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:12:44 user nova-compute[75621]:       <mac address="fa:16:3e:6e:13:bf"/>
Nov 27 23:12:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:44 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:12:44 user nova-compute[75621]:       <target dev="tapcf6eb519-62"/>
Nov 27 23:12:44 user nova-compute[75621]:     </interface>
Nov 27 23:12:44 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:12:44 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657/console.log" append="off"/>
Nov 27 23:12:44 user nova-compute[75621]:     </serial>
Nov 27 23:12:44 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:12:44 user nova-compute[75621]:     <video>
Nov 27 23:12:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:44 user nova-compute[75621]:     </video>
Nov 27 23:12:44 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:12:44 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:12:44 user nova-compute[75621]:     </rng>
Nov 27 23:12:44 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:12:44 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:12:44 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:12:44 user nova-compute[75621]:     </memballoon>
Nov 27 23:12:44 user nova-compute[75621]:   </devices>
Nov 27 23:12:44 user nova-compute[75621]: </domain>
Nov 27 23:12:44 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_vif [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff51dc1-1746-569f-b0ce-b422d765e6f3', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6b36c6-1573-4bb4-85ef-41d12b9bd982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980] added
Nov 27 23:12:44 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf6eb519-62, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf6eb519-62, col_values=(('qos', UUID('2d6c6364-0d6a-44ce-8e2d-0271732b042b')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf6eb519-62, col_values=(('external_ids', {'iface-id': 'cf6eb519-6256-422e-871e-4dd93ca7711b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:13:bf', 'vm-uuid': '203ff896-ed38-4378-9146-075fb92cf657'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[702bc6dc-deea-474f-a676-872b0865c478]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:44 user nova-compute[75621]: INFO os_vif [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62')
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc256f-e3ec-434d-a15c-3e453c77149d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLUWJqsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLUWJqsi" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f9e4a1-a6ff-4954-aaf5-5ef3128b1f43]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLUWJqsi'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:6e:13:bf, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c952c9-5a3f-40fe-a846-43a76cca50e2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7513874-7b41-487e-877b-6457c880df8f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:44 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:44 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:44 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9614385-8380-45d6-9b3a-949a8a7f1cb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260]
Nov 27 23:12:45 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a461de1f-7c23-47e7-982a-ab5c019c4505]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3341d9e-e8c2-4037-a59f-f820aac3c447]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:45 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa97332-3eeb-40ec-9a9a-e60d0dba5739]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:12:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== connect_volume: return (2783ms) {'type': 'block', 'scsi_wwn': '26534336561303636', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534336561303636', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1098098055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1098098055',id=30,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-002dwlh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:30Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=89a23062-cf16-4dd9-b6e8-7483115ca1c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:12:46 user nova-compute[75621]:   <uuid>89a23062-cf16-4dd9-b6e8-7483115ca1c3</uuid>
Nov 27 23:12:46 user nova-compute[75621]:   <name>instance-0000001e</name>
Nov 27 23:12:46 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:12:46 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:12:46 user nova-compute[75621]:   <metadata>
Nov 27 23:12:46 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:12:46 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1098098055</nova:name>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:12:43</nova:creationTime>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:12:46 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:12:46 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:owner>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:12:46 user nova-compute[75621]:       </nova:owner>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:12:46 user nova-compute[75621]:       <nova:ports>
Nov 27 23:12:46 user nova-compute[75621]:         <nova:port uuid="6bc17f22-a156-4844-8a19-a37664ce1d9e">
Nov 27 23:12:46 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:12:46 user nova-compute[75621]:         </nova:port>
Nov 27 23:12:46 user nova-compute[75621]:       </nova:ports>
Nov 27 23:12:46 user nova-compute[75621]:     </nova:instance>
Nov 27 23:12:46 user nova-compute[75621]:   </metadata>
Nov 27 23:12:46 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:12:46 user nova-compute[75621]:     <system>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="serial">89a23062-cf16-4dd9-b6e8-7483115ca1c3</entry>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="uuid">89a23062-cf16-4dd9-b6e8-7483115ca1c3</entry>
Nov 27 23:12:46 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:12:46 user nova-compute[75621]:     </system>
Nov 27 23:12:46 user nova-compute[75621]:   </sysinfo>
Nov 27 23:12:46 user nova-compute[75621]:   <os>
Nov 27 23:12:46 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:12:46 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:12:46 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:12:46 user nova-compute[75621]:   </os>
Nov 27 23:12:46 user nova-compute[75621]:   <features>
Nov 27 23:12:46 user nova-compute[75621]:     <acpi/>
Nov 27 23:12:46 user nova-compute[75621]:     <apic/>
Nov 27 23:12:46 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:12:46 user nova-compute[75621]:   </features>
Nov 27 23:12:46 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:12:46 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:12:46 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:12:46 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:12:46 user nova-compute[75621]:   </clock>
Nov 27 23:12:46 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:12:46 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:12:46 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:12:46 user nova-compute[75621]:   </cpu>
Nov 27 23:12:46 user nova-compute[75621]:   <devices>
Nov 27 23:12:46 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:12:46 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:46 user nova-compute[75621]:       <source dev="/dev/sdf"/>
Nov 27 23:12:46 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:12:46 user nova-compute[75621]:       <serial>71cf7f9a-e2e6-455b-8065-0ecde4d24980</serial>
Nov 27 23:12:46 user nova-compute[75621]:     </disk>
Nov 27 23:12:46 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:12:46 user nova-compute[75621]:       <mac address="fa:16:3e:21:07:4d"/>
Nov 27 23:12:46 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:46 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:12:46 user nova-compute[75621]:       <target dev="tap6bc17f22-a1"/>
Nov 27 23:12:46 user nova-compute[75621]:     </interface>
Nov 27 23:12:46 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:12:46 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/console.log" append="off"/>
Nov 27 23:12:46 user nova-compute[75621]:     </serial>
Nov 27 23:12:46 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:12:46 user nova-compute[75621]:     <video>
Nov 27 23:12:46 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:46 user nova-compute[75621]:     </video>
Nov 27 23:12:46 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:12:46 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:12:46 user nova-compute[75621]:     </rng>
Nov 27 23:12:46 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:12:46 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:12:46 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:12:46 user nova-compute[75621]:     </memballoon>
Nov 27 23:12:46 user nova-compute[75621]:   </devices>
Nov 27 23:12:46 user nova-compute[75621]: </domain>
Nov 27 23:12:46 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1098098055',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1098098055',id=30,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-002dwlh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:30Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=89a23062-cf16-4dd9-b6e8-7483115ca1c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG os_vif [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57d5c2b4-5293-5e19-ba78-8c9ecf63b2d3', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bc17f22-a1, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bc17f22-a1, col_values=(('qos', UUID('52a91487-3530-4214-b9f2-6ea617179613')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bc17f22-a1, col_values=(('external_ids', {'iface-id': '6bc17f22-a156-4844-8a19-a37664ce1d9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:07:4d', 'vm-uuid': '89a23062-cf16-4dd9-b6e8-7483115ca1c3'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: INFO os_vif [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1')
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:21:07:4d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:46 user nova-compute[75621]: WARNING nova.compute.manager [req-0436cf59-0ffd-45c5-abc0-82cd80aba29a req-a9ae8b51-7593-421a-a881-d92cfbf9fbdd service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state building and task_state spawning.
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:12:47 user nova-compute[75621]: INFO nova.compute.claims [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Claim successful on node user
Nov 27 23:12:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.policy [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c7f3a4fe69a492aab4db9062a6d838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565ce700aeda4eb49c85cd697a9c0736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:12:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Creating image(s)
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:48 user nova-compute[75621]: WARNING nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state building and task_state spawning.
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:48 user nova-compute[75621]: WARNING nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state building and task_state spawning.
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:48 user nova-compute[75621]: WARNING nova.compute.manager [req-971307d3-f191-48d9-8d57-44ac7cff5d29 req-e61548a7-6f79-44ba-87c3-55eb9444f4e1 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state building and task_state spawning.
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk 1073741824" returned: 0 in 0.052s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Successfully created port: 68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Cannot resize image /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Ensure instance console log exists: /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:12:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance spawned successfully.
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:49 user nova-compute[75621]: INFO nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Successfully updated port: 68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquired lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:12:49 user nova-compute[75621]: INFO nova.compute.manager [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Took 24.03 seconds to build instance.
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-changed-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Refreshing instance network info cache due to event network-changed-68b73255-f1eb-457b-b38e-6b5b75196004. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] Acquiring lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d3f874e4-352b-48fe-af22-2ffe3780a691 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.125s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updating instance_info_cache with network_info: [{"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance spawned successfully.
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Releasing lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Instance network_info: |[{"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] Acquired lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.network.neutron [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Refreshing network info cache for port 68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:12:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Start _get_guest_xml network_info=[{"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2003661644',display_name='tempest-AttachVolumeNegativeTest-server-2003661644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2003661644',id=31,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJkchusOkvRvSQmZBFKmoSY0hh45CHBfZhTqEfLAyYPHfhBbv7A4Zdq+fCZIpCA6w6t8c17qH90MK48qFBXcbycvrBi9APdMErNyQu8tM++ThEvmQHl59+NBS1I7vDKVw==',key_name='tempest-keypair-456027875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-p1umaqbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=b8808143-079a-4d07-8b4b-1f76a875b6f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'pci_devices' on Instance uuid b8808143-079a-4d07-8b4b-1f76a875b6f7 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:50 user nova-compute[75621]: INFO nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:12:50 user nova-compute[75621]:   <uuid>b8808143-079a-4d07-8b4b-1f76a875b6f7</uuid>
Nov 27 23:12:50 user nova-compute[75621]:   <name>instance-0000001f</name>
Nov 27 23:12:50 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:12:50 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:12:50 user nova-compute[75621]:   <metadata>
Nov 27 23:12:50 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:12:50 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2003661644</nova:name>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:12:50</nova:creationTime>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:12:50 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:12:50 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:owner>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:user uuid="6c7f3a4fe69a492aab4db9062a6d838b">tempest-AttachVolumeNegativeTest-862898080-project-member</nova:user>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:project uuid="565ce700aeda4eb49c85cd697a9c0736">tempest-AttachVolumeNegativeTest-862898080</nova:project>
Nov 27 23:12:50 user nova-compute[75621]:       </nova:owner>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:12:50 user nova-compute[75621]:       <nova:ports>
Nov 27 23:12:50 user nova-compute[75621]:         <nova:port uuid="68b73255-f1eb-457b-b38e-6b5b75196004">
Nov 27 23:12:50 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:12:50 user nova-compute[75621]:         </nova:port>
Nov 27 23:12:50 user nova-compute[75621]:       </nova:ports>
Nov 27 23:12:50 user nova-compute[75621]:     </nova:instance>
Nov 27 23:12:50 user nova-compute[75621]:   </metadata>
Nov 27 23:12:50 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:12:50 user nova-compute[75621]:     <system>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="serial">b8808143-079a-4d07-8b4b-1f76a875b6f7</entry>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="uuid">b8808143-079a-4d07-8b4b-1f76a875b6f7</entry>
Nov 27 23:12:50 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:12:50 user nova-compute[75621]:     </system>
Nov 27 23:12:50 user nova-compute[75621]:   </sysinfo>
Nov 27 23:12:50 user nova-compute[75621]:   <os>
Nov 27 23:12:50 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:12:50 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:12:50 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:12:50 user nova-compute[75621]:   </os>
Nov 27 23:12:50 user nova-compute[75621]:   <features>
Nov 27 23:12:50 user nova-compute[75621]:     <acpi/>
Nov 27 23:12:50 user nova-compute[75621]:     <apic/>
Nov 27 23:12:50 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:12:50 user nova-compute[75621]:   </features>
Nov 27 23:12:50 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:12:50 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:12:50 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:12:50 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:12:50 user nova-compute[75621]:   </clock>
Nov 27 23:12:50 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:12:50 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:12:50 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:12:50 user nova-compute[75621]:   </cpu>
Nov 27 23:12:50 user nova-compute[75621]:   <devices>
Nov 27 23:12:50 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:12:50 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:12:50 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk"/>
Nov 27 23:12:50 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:12:50 user nova-compute[75621]:     </disk>
Nov 27 23:12:50 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:12:50 user nova-compute[75621]:       <mac address="fa:16:3e:ac:0d:6d"/>
Nov 27 23:12:50 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:50 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:12:50 user nova-compute[75621]:       <target dev="tap68b73255-f1"/>
Nov 27 23:12:50 user nova-compute[75621]:     </interface>
Nov 27 23:12:50 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:12:50 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/console.log" append="off"/>
Nov 27 23:12:50 user nova-compute[75621]:     </serial>
Nov 27 23:12:50 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:12:50 user nova-compute[75621]:     <video>
Nov 27 23:12:50 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:12:50 user nova-compute[75621]:     </video>
Nov 27 23:12:50 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:12:50 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:12:50 user nova-compute[75621]:     </rng>
Nov 27 23:12:50 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:12:50 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:12:50 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:12:50 user nova-compute[75621]:     </memballoon>
Nov 27 23:12:50 user nova-compute[75621]:   </devices>
Nov 27 23:12:50 user nova-compute[75621]: </domain>
Nov 27 23:12:50 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2003661644',display_name='tempest-AttachVolumeNegativeTest-server-2003661644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2003661644',id=31,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJkchusOkvRvSQmZBFKmoSY0hh45CHBfZhTqEfLAyYPHfhBbv7A4Zdq+fCZIpCA6w6t8c17qH90MK48qFBXcbycvrBi9APdMErNyQu8tM++ThEvmQHl59+NBS1I7vDKVw==',key_name='tempest-keypair-456027875',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-p1umaqbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=b8808143-079a-4d07-8b4b-1f76a875b6f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_vif [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b954e350-13fb-55a9-abac-7d271833f274', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b73255-f1, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68b73255-f1, col_values=(('qos', UUID('45b3e3bf-ae19-4e60-a834-db609d11e59a')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68b73255-f1, col_values=(('external_ids', {'iface-id': '68b73255-f1eb-457b-b38e-6b5b75196004', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:0d:6d', 'vm-uuid': 'b8808143-079a-4d07-8b4b-1f76a875b6f7'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:50 user nova-compute[75621]: INFO os_vif [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1')
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:ac:0d:6d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:50 user nova-compute[75621]: INFO nova.compute.manager [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Took 21.26 seconds to build instance.
Nov 27 23:12:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab0a2b68-a168-4740-ab8e-32137de9be1f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.396s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updated VIF entry in instance network info cache for port 68b73255-f1eb-457b-b38e-6b5b75196004. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updating instance_info_cache with network_info: [{"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30b1fb16-41cd-45cc-bc19-8600eb17717e req-76ac9182-07d6-4ce8-ac09-ed656f2a87af service nova] Releasing lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmEHABoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:12:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:12:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:12:50 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:12:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfc8a21-d89c-4011-9b36-7c48a18872db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:12:51 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4f9b2a-591f-45b9-a4a8-9a389f1c444f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e] added
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1f0a01-3ec4-4fd0-a737-5a5e05670c51]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78965777-a6c7-4701-b24a-f865ca12cc50]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmEHABoR {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LmEHABoR" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[521124bd-2357-46b3-b8c5-7fae68b7e6c5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LmEHABoR'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff4585-6893-4974-824b-bd60d8bdaec2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8504926-a719-4b69-81c6-70d3ca6f7bf1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[026f3826-29f6-4d57-87ac-cd4ece9e4195]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260]
Nov 27 23:12:51 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260] successful.
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda034b-6aa0-4d00-828a-39d4a189fc24]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30c58e2-d585-4e1a-b03a-6088b36d37e5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:12:51 user nova-compute[75621]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)
Nov 27 23:12:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] HCTL ('38', '-', '-', 0) found on session 36 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a23433-ecd9-4205-9dcf-8aa614cf7f3b]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] No waiting events found dispatching network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:51 user nova-compute[75621]: WARNING nova.compute.manager [req-12a65f63-df76-4e4f-9987-a03b042d5189 req-83a4b7d3-2468-488f-92f0-81c806b5b91f service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received unexpected event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 for instance with vm_state building and task_state spawning.
Nov 27 23:12:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Searching for a device in session 36 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmEHABoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23462326262666266', 'path': '/dev/sdg'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462326262666266', 'path': '/dev/sdg'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:12:52 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:52 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:12:52 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:52 user nova-compute[75621]:   <serial>d435bb60-3d69-4840-bc63-7d123b5ec32e</serial>
Nov 27 23:12:52 user nova-compute[75621]: </disk>
Nov 27 23:12:52 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] No VIF found with MAC fa:16:3e:59:85:77, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-969a359d-e4b6-4ae4-90a4-b22411a82055 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.047s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] No waiting events found dispatching network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:12:53 user nova-compute[75621]: WARNING nova.compute.manager [req-cf20e02a-e4d5-4dc6-9e42-e621bf6f7510 req-ba74f584-cb79-4c91-9bec-ea02cbf53a5b service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received unexpected event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 for instance with vm_state building and task_state spawning.
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:12:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Instance spawned successfully.
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:12:54 user nova-compute[75621]: INFO nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Took 6.00 seconds to spawn the instance on the hypervisor.
Nov 27 23:12:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:12:54 user nova-compute[75621]: INFO nova.compute.manager [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Took 7.04 seconds to build instance.
Nov 27 23:12:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-83ac9fb3-bdd6-4416-8bc6-90de3dbf103a tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.151s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:54 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:55 user nova-compute[75621]: INFO nova.compute.manager [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Detaching volume d435bb60-3d69-4840-bc63-7d123b5ec32e
Nov 27 23:12:55 user nova-compute[75621]: INFO nova.virt.block_device [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Attempting to driver detach volume d435bb60-3d69-4840-bc63-7d123b5ec32e from mountpoint /dev/vdb
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Attempting to detach device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:12:55 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:55 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:12:55 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:55 user nova-compute[75621]:   <serial>d435bb60-3d69-4840-bc63-7d123b5ec32e</serial>
Nov 27 23:12:55 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:12:55 user nova-compute[75621]: </disk>
Nov 27 23:12:55 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:12:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the persistent domain config.
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:12:55 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:12:55 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:12:55 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:12:55 user nova-compute[75621]:   <serial>d435bb60-3d69-4840-bc63-7d123b5ec32e</serial>
Nov 27 23:12:55 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:12:55 user nova-compute[75621]: </disk>
Nov 27 23:12:55 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:12:55 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.358s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:12:59 user nova-compute[75621]: INFO nova.compute.manager [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Rescuing
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:12:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG nova.network.neutron [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:01 user nova-compute[75621]: WARNING nova.compute.manager [req-da474bd4-dda5-4f20-bb57-cb17e2786474 req-46c106ba-64bd-420f-a1cc-e00ad3f846d4 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state active and task_state rescuing.
Nov 27 23:13:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance destroyed successfully.
Nov 27 23:13:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Attempting rescue
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:13:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Creating image(s)
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue" returned: 0 in 0.090s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'migration_context' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.base [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<b9193c89-2a48-45c6-bbf2-2d7363bf565e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start _get_guest_xml network_info=[{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:5f:e8:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.base [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<b9193c89-2a48-45c6-bbf2-2d7363bf565e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'numa_topology' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.base [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<b9193c89-2a48-45c6-bbf2-2d7363bf565e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:13:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:13:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.base [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<b9193c89-2a48-45c6-bbf2-2d7363bf565e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563489341',display_name='tempest-ServerRescueNegativeTestJSON-server-563489341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563489341',id=23,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:08:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-f81o6anz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:08:25Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=b9193c89-2a48-45c6-bbf2-2d7363bf565e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:5f:e8:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:5f:e8:d7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.objects.base [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<b9193c89-2a48-45c6-bbf2-2d7363bf565e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:13:01 user nova-compute[75621]:   <uuid>b9193c89-2a48-45c6-bbf2-2d7363bf565e</uuid>
Nov 27 23:13:01 user nova-compute[75621]:   <name>instance-00000017</name>
Nov 27 23:13:01 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:13:01 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:13:01 user nova-compute[75621]:   <metadata>
Nov 27 23:13:01 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:13:01 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-563489341</nova:name>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:13:01</nova:creationTime>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:13:01 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:13:01 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:owner>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:13:01 user nova-compute[75621]:       </nova:owner>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:13:01 user nova-compute[75621]:       <nova:ports>
Nov 27 23:13:01 user nova-compute[75621]:         <nova:port uuid="76823b6c-283b-4999-893a-8766802981ec">
Nov 27 23:13:01 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:13:01 user nova-compute[75621]:         </nova:port>
Nov 27 23:13:01 user nova-compute[75621]:       </nova:ports>
Nov 27 23:13:01 user nova-compute[75621]:     </nova:instance>
Nov 27 23:13:01 user nova-compute[75621]:   </metadata>
Nov 27 23:13:01 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:13:01 user nova-compute[75621]:     <system>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="serial">b9193c89-2a48-45c6-bbf2-2d7363bf565e</entry>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="uuid">b9193c89-2a48-45c6-bbf2-2d7363bf565e</entry>
Nov 27 23:13:01 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:13:01 user nova-compute[75621]:     </system>
Nov 27 23:13:01 user nova-compute[75621]:   </sysinfo>
Nov 27 23:13:01 user nova-compute[75621]:   <os>
Nov 27 23:13:01 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:13:01 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:13:01 user nova-compute[75621]:   </os>
Nov 27 23:13:01 user nova-compute[75621]:   <features>
Nov 27 23:13:01 user nova-compute[75621]:     <acpi/>
Nov 27 23:13:01 user nova-compute[75621]:     <apic/>
Nov 27 23:13:01 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:13:01 user nova-compute[75621]:   </features>
Nov 27 23:13:01 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:13:01 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:13:01 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:13:01 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:13:01 user nova-compute[75621]:   </clock>
Nov 27 23:13:01 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:13:01 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:13:01 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:13:01 user nova-compute[75621]:   </cpu>
Nov 27 23:13:01 user nova-compute[75621]:   <devices>
Nov 27 23:13:01 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:13:01 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:13:01 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue"/>
Nov 27 23:13:01 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:13:01 user nova-compute[75621]:     </disk>
Nov 27 23:13:01 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:13:01 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:13:01 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk"/>
Nov 27 23:13:01 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:13:01 user nova-compute[75621]:     </disk>
Nov 27 23:13:01 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:13:01 user nova-compute[75621]:       <mac address="fa:16:3e:5f:e8:d7"/>
Nov 27 23:13:01 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:13:01 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:13:01 user nova-compute[75621]:       <target dev="tap76823b6c-28"/>
Nov 27 23:13:01 user nova-compute[75621]:     </interface>
Nov 27 23:13:01 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:13:01 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/console.log" append="off"/>
Nov 27 23:13:01 user nova-compute[75621]:     </serial>
Nov 27 23:13:01 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:13:01 user nova-compute[75621]:     <video>
Nov 27 23:13:01 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:13:01 user nova-compute[75621]:     </video>
Nov 27 23:13:01 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:13:01 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:13:01 user nova-compute[75621]:     </rng>
Nov 27 23:13:01 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:13:01 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:13:01 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:13:01 user nova-compute[75621]:     </memballoon>
Nov 27 23:13:01 user nova-compute[75621]:   </devices>
Nov 27 23:13:01 user nova-compute[75621]: </domain>
Nov 27 23:13:01 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:13:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance destroyed successfully.
Nov 27 23:13:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:13:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:13:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7153MB free_disk=24.731082916259766GB free_vcpus=-4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:5f:e8:d7, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0ad520b-a961-42cd-bb7e-67329a158e5d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance c536051b-9b80-4df7-8903-3b0db3a9050e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8808143-079a-4d07-8b4b-1f76a875b6f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:13:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=13GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:03 user nova-compute[75621]: WARNING nova.compute.manager [req-cee2182a-58c3-4956-b363-70e50936849d req-f2cd21c5-8e9f-4c24-bbff-81d17d86b76e service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state active and task_state rescuing.
Nov 27 23:13:03 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.649s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:05 user nova-compute[75621]: WARNING nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state active and task_state rescuing.
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:05 user nova-compute[75621]: WARNING nova.compute.manager [req-983e657d-23c4-4a29-aebd-22d636138e37 req-a002832c-7414-47e9-993e-9226e98ee1eb service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state active and task_state rescuing.
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updating instance_info_cache with network_info: [{"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-d0ad520b-a961-42cd-bb7e-67329a158e5d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:13:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3f255c01-79b8-4efe-8a89-6e9cfa7b110a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:07 user nova-compute[75621]: INFO nova.compute.manager [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Terminating instance
Nov 27 23:13:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-3a11be9a-4c76-4d8c-a4db-8f90620697f6 req-f3075135-7014-4659-8562-9c24fc537000 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-unplugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:13:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Instance destroyed successfully.
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lazy-loading 'resources' on Instance uuid c536051b-9b80-4df7-8903-3b0db3a9050e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:05:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1425970357',display_name='tempest-ServerStableDeviceRescueTest-server-1425970357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1425970357',id=18,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJq5yF8DSj7abh0f8z8HoIS9bHyO3inf8ShuA1FDnHEUIbSWMrEIi/hPpoLYLBr0EFqZ4um0kWCoydZrS/bUq8hKtwxF5akLVEPB60+Bz4gtIIqE4sWE1du5C7RJSr7t6w==',key_name='tempest-keypair-17915930',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe1cd748f87c4bb89ed90e11966cf34c',ramdisk_id='',reservation_id='r-0ozdxk1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-784559379',owner_user_name='tempest-ServerStableDeviceRescueTest-784559379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bd541264d3d49d4a6af59c1fc0765d7',uuid=c536051b-9b80-4df7-8903-3b0db3a9050e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converting VIF {"id": "41832a48-3bfe-4379-b729-eb69507911ef", "address": "fa:16:3e:40:dd:9e", "network": {"id": "7d119a33-f159-485d-9862-fa21dbdc9394", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-88112093-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe1cd748f87c4bb89ed90e11966cf34c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41832a48-3b", "ovs_interfaceid": "41832a48-3bfe-4379-b729-eb69507911ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG os_vif [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41832a48-3b, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=972acfd5-3cf1-433a-8aaa-81620e42c1d5) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:08 user nova-compute[75621]: INFO os_vif [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:dd:9e,bridge_name='br-int',has_traffic_filtering=True,id=41832a48-3bfe-4379-b729-eb69507911ef,network=Network(7d119a33-f159-485d-9862-fa21dbdc9394),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41832a48-3b')
Nov 27 23:13:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Deleting instance files /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e_del
Nov 27 23:13:08 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Deletion of /opt/stack/data/nova/instances/c536051b-9b80-4df7-8903-3b0db3a9050e_del complete
Nov 27 23:13:08 user nova-compute[75621]: INFO nova.compute.manager [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 23:13:08 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:13:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:09 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:13:09 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Took 0.92 seconds to deallocate network for instance.
Nov 27 23:13:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-32ac3278-788f-412b-9578-f9d02c1d1705 req-8c8c88ac-ae92-4a83-930f-81d47164a140 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-deleted-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] Acquiring lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] No waiting events found dispatching network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:10 user nova-compute[75621]: WARNING nova.compute.manager [req-b4ccc136-17bd-408f-a67f-ba0fb804c950 req-dc0e550b-a4b3-47c6-8de5-290cc8a24c56 service nova] [instance: c536051b-9b80-4df7-8903-3b0db3a9050e] Received unexpected event network-vif-plugged-41832a48-3bfe-4379-b729-eb69507911ef for instance with vm_state deleted and task_state None.
Nov 27 23:13:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:10 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Deleted allocations for instance c536051b-9b80-4df7-8903-3b0db3a9050e
Nov 27 23:13:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-401b173c-ae10-415b-89bb-4beb928d7666 tempest-ServerStableDeviceRescueTest-784559379 tempest-ServerStableDeviceRescueTest-784559379-project-member] Lock "c536051b-9b80-4df7-8903-3b0db3a9050e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.535s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:15 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b637ed1f-2fc0-4484-b721-850dca879491 is timed out.
Nov 27 23:13:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully detached device vdb from instance b637ed1f-2fc0-4484-b721-850dca879491 from the live domain config.
Nov 27 23:13:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LmEHABoR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:15 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9a1e90-d02f-412e-a376-c503573b9142]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:13:15 user nova-compute[75621]: No targets found.
Nov 27 23:13:15 user nova-compute[75621]: iSNS:
Nov 27 23:13:15 user nova-compute[75621]: No targets found.
Nov 27 23:13:15 user nova-compute[75621]: STATIC:
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e
Nov 27 23:13:15 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:15 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:15 user nova-compute[75621]: FIRMWARE:
Nov 27 23:13:15 user nova-compute[75621]: No targets found.
Nov 27 23:13:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:13:15 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:13:15 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88498374-f3cc-4b29-b421-82f6f63841d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63b61d6-40b2-444d-a54e-dc040eefc80c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)
Nov 27 23:13:16 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:16 user nova-compute[75621]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e (non-flash)
Nov 27 23:13:16 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e06e77f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e'): ({'sdg'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Removing single pathed devices sdg {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a6f510-45d9-48a8-8bcb-0a83100c34b4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5837ed61-648f-4304-bcea-da04d5c23255]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Flushing IO for device /dev/sdg {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4731aa-fb74-4ea0-a3be-fb8c2052d51e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30f126c-a660-44ce-aef2-70fef631ac13]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[189492b3-5e1b-4c39-9869-bfbcb2316989]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88764328-9def-4e2b-8117-16a1d2bb5af0]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260]
Nov 27 23:13:16 user nova-compute[75621]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e, portal: 172.16.0.220,3260] successful.
Nov 27 23:13:16 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d435bb60-3d69-4840-bc63-7d123b5ec32e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db6c098-d838-4e3a-8c4f-87ede6f21f66]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] <== disconnect_volume: return (316ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:13:16 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'flavor' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e872b163-d3f4-4dff-9692-07b5c41fe3e0 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.727s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:18 user nova-compute[75621]: INFO nova.compute.manager [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Detaching volume a84cb56c-a0b6-4192-854d-06fc96c1a778
Nov 27 23:13:18 user nova-compute[75621]: INFO nova.virt.block_device [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Attempting to driver detach volume a84cb56c-a0b6-4192-854d-06fc96c1a778 from mountpoint /dev/vdc
Nov 27 23:13:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Attempting to detach device vdc from instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:13:18 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:18 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:13:18 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:13:18 user nova-compute[75621]:   <serial>a84cb56c-a0b6-4192-854d-06fc96c1a778</serial>
Nov 27 23:13:18 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:13:18 user nova-compute[75621]: </disk>
Nov 27 23:13:18 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:13:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully detached device vdc from instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 from the persistent domain config.
Nov 27 23:13:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:13:18 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:18 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:13:18 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:13:18 user nova-compute[75621]:   <serial>a84cb56c-a0b6-4192-854d-06fc96c1a778</serial>
Nov 27 23:13:18 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 27 23:13:18 user nova-compute[75621]: </disk>
Nov 27 23:13:18 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:13:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-changed-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Refreshing instance network info cache due to event network-changed-e449eb71-f371-4604-afd1-e19f0c9cc7e8. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:13:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] Acquiring lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:13:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] Acquired lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:13:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Refreshing network info cache for port e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:13:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updated VIF entry in instance network info cache for port e449eb71-f371-4604-afd1-e19f0c9cc7e8. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:13:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating instance_info_cache with network_info: [{"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:13:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7dc6c9d4-6a39-4d83-acbb-441a59e66897 req-26ffc3f9-fdbc-43fc-a13b-c4a3fffd3f01 service nova] Releasing lock "refresh_cache-de02eaf0-a5ee-4514-8ccd-53e92766ee05" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:13:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG nova.objects.instance [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:35 user nova-compute[75621]: INFO nova.compute.manager [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attaching volume 363601ca-548e-4266-93ba-cbc3be41d5be to /dev/vdb
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.utils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89826aa-cc53-4f3e-bd39-a6651e31a126]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e30d7b8-38fc-4827-8dcb-f75d51b15be8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc9a8fc-c2e1-436f-9960-2b2f5cc3b350]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db62ccb4-09e0-47ca-90a6-aa20e07fd4f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:13:35 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:13:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4851b7-9c8b-4fb4-a5ad-81976f050afd]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG os_brick.utils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:35 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating existing volume attachment record: 701209ed-c0f0-473a-b521-3c9cdbd69219 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:38 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 is timed out.
Nov 27 23:13:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully detached device vdc from instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 from the live domain config.
Nov 27 23:13:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VzirIsEn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:38 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea1350d-d795-475f-9cb0-e05aaff2592e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:13:38 user nova-compute[75621]: No targets found.
Nov 27 23:13:38 user nova-compute[75621]: iSNS:
Nov 27 23:13:38 user nova-compute[75621]: No targets found.
Nov 27 23:13:38 user nova-compute[75621]: STATIC:
Nov 27 23:13:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:13:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:13:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:13:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778
Nov 27 23:13:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:13:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:13:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:13:38 user nova-compute[75621]: FIRMWARE:
Nov 27 23:13:38 user nova-compute[75621]: No targets found.
Nov 27 23:13:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:13:38 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:13:38 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[74893805-39f9-40f1-bdd2-4e48689aabc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[548f4d03-5c3f-4734-a36d-e338c91adfb6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:38 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0759c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d7780e-99ba-4b11-ac6e-39b7517d1714]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17edcfb9-8256-4670-8a0c-b51f7f3fa9ef]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[874999f6-6442-4a20-9cca-c0a9e2942b18]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76762c7b-d43d-4631-a3fe-11b6542d5d7f]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[121c60ab-2414-44c5-a6e6-553037cc3f20]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d064247-f759-4cbf-baae-0c8fe58706cb]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260]
Nov 27 23:13:38 user nova-compute[75621]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778, portal: 172.16.0.220,3260] successful.
Nov 27 23:13:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a84cb56c-a0b6-4192-854d-06fc96c1a778 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a7f919-8bc3-4db0-9d2e-8e73716725f8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] <== disconnect_volume: return (319ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:13:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'flavor' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5aa5802e-39e7-496e-9e19-1da115d283ae tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.798s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:42 user nova-compute[75621]: INFO nova.compute.manager [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Terminating instance
Nov 27 23:13:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-unplugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] No waiting events found dispatching network-vif-unplugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-788aa32b-a150-4b82-aac8-da057a23e459 req-80ae229f-a248-4e24-bd0e-e1897c9e3513 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-unplugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adKfntWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:43 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b10db-1bbd-43d7-a02d-2bfa800a994b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:13:43 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4350ec-81c6-4bb3-b47c-dec65ef45867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be] added
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[839988d2-062e-4a89-ae5c-34ba7460a634]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d24d5b-984d-4f5f-a397-38b249bb257b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adKfntWU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v adKfntWU" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3340481a-11d6-4591-b781-ab2b8c42aa09]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'adKfntWU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d5babc-800b-48af-be35-90bfaff9e751]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[40903fea-026d-422b-845b-c96cd1d2d332]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fd33c5-578c-4515-b291-f184a0d425e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260]
Nov 27 23:13:43 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260] successful.
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1b0354-3f6c-4ac1-ac5b-2a50b16fc3a0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Instance destroyed successfully.
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lazy-loading 'resources' on Instance uuid d0ad520b-a961-42cd-bb7e-67329a158e5d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:04:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1292644308',display_name='tempest-ServersNegativeTestJSON-server-1292644308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1292644308',id=16,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1344bc4bacbb477fa732dd9c2b4d191a',ramdisk_id='',reservation_id='r-jxsoem81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-628018506',owner_user_name='tempest-ServersNegativeTestJSON-628018506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:05:06Z,user_data=None,user_id='98804fc0734a4911a2ec7cf891793b16',uuid=d0ad520b-a961-42cd-bb7e-67329a158e5d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converting VIF {"id": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "address": "fa:16:3e:28:d9:1d", "network": {"id": "7b7e2462-163f-4319-99c6-a2d4c49aed90", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1684656952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1344bc4bacbb477fa732dd9c2b4d191a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e7f41f4-d0", "ovs_interfaceid": "3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_vif [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3708642c-81c6-417c-abf2-2c184db6be5c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:43 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e7f41f4-d0, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a99363a-03c2-4108-acf7-a750796762dd) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:43 user nova-compute[75621]: INFO os_vif [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:d9:1d,bridge_name='br-int',has_traffic_filtering=True,id=3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6,network=Network(7b7e2462-163f-4319-99c6-a2d4c49aed90),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e7f41f4-d0')
Nov 27 23:13:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Deleting instance files /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d_del
Nov 27 23:13:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Deletion of /opt/stack/data/nova/instances/d0ad520b-a961-42cd-bb7e-67329a158e5d_del complete
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b26c5-2e8a-4549-9355-e5720aa9daa2]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adKfntWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:13:43 user nova-compute[75621]: INFO nova.compute.manager [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 27 23:13:43 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:13:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:13:44 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Took 0.56 seconds to deallocate network for instance.
Nov 27 23:13:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26335323738316165', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323738316165', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:13:44 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:44 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:13:44 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:13:44 user nova-compute[75621]:   <serial>363601ca-548e-4266-93ba-cbc3be41d5be</serial>
Nov 27 23:13:44 user nova-compute[75621]: </disk>
Nov 27 23:13:44 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:13:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:44 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Deleted allocations for instance d0ad520b-a961-42cd-bb7e-67329a158e5d
Nov 27 23:13:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4b49f39d-53db-41e2-900f-9e6975d91712 tempest-ServersNegativeTestJSON-628018506 tempest-ServersNegativeTestJSON-628018506-project-member] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.129s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No VIF found with MAC fa:16:3e:42:1a:5f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] Acquiring lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] Lock "d0ad520b-a961-42cd-bb7e-67329a158e5d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] No waiting events found dispatching network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:13:45 user nova-compute[75621]: WARNING nova.compute.manager [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received unexpected event network-vif-plugged-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 for instance with vm_state deleted and task_state None.
Nov 27 23:13:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-6f890d88-36ed-4d64-adfe-34b937f49f14 req-9db186dc-4306-4de9-a41a-7df51d885320 service nova] [instance: d0ad520b-a961-42cd-bb7e-67329a158e5d] Received event network-vif-deleted-3e7f41f4-d099-4ab7-8df7-ea8b187b2bf6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:13:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da8f6055-e90b-49d6-9007-096134b917c1 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.493s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:48 user nova-compute[75621]: INFO nova.compute.manager [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attaching volume e93378d4-ce0f-41aa-8fe5-e52053698b52 to /dev/vdc
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.utils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89d89a-f299-42f2-ab1a-2060e1723684]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c87ed-2f09-421b-8d6a-bb215d5e25a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd057b88-af9b-4165-aecf-40bed54b7ecd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46cf7e-a92d-44e2-b238-1189c00b80de]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:13:48 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0209f59-8137-40aa-8b67-b85cac8c1e95]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG os_brick.utils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating existing volume attachment record: e537c837-8645-4b67-90e8-f129356c4b21 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:13:52 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:54 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suvZzwBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:13:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:13:55 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db71fb85-be46-4059-adc2-0bd1a7aaaf5f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:13:55 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1a865c-3cad-4870-9674-0780c4821417]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52] added
Nov 27 23:13:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6574ace-2206-4ebe-b9a4-1f56d9504a8c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d37d93-d73c-4245-aa01-e9820d8f3061]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suvZzwBx {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v suvZzwBx" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d84e0c-28b1-44b0-a82e-03e78ee007ce]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'suvZzwBx'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58d0a80-8496-4b8c-ada1-e9d23fdfcfd2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab66dfcf-0fda-4427-96bb-4edea557daf6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef3f27a-d997-4c82-9599-920a99031da1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260]
Nov 27 23:13:56 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260] successful.
Nov 27 23:13:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[991bf172-cdf4-471f-a51f-4dc5fb30e02c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff9809b-eb3d-42ff-a828-386d97c34405]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:13:56 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:13:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] HCTL ('38', '-', '-', 0) found on session 38 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7d80c8-8940-408e-9246-cf68020de70e]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:56 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Searching for a device in session 38 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suvZzwBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26561356562313832', 'path': '/dev/sdg'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561356562313832', 'path': '/dev/sdg'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:13:57 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:57 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:13:57 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:13:57 user nova-compute[75621]:   <serial>e93378d4-ce0f-41aa-8fe5-e52053698b52</serial>
Nov 27 23:13:57 user nova-compute[75621]: </disk>
Nov 27 23:13:57 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] No VIF found with MAC fa:16:3e:42:1a:5f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a64f3a98-cbb8-4514-b080-9badc31e9f7f tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.584s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:13:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:13:58 user nova-compute[75621]: INFO nova.compute.manager [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Detaching volume 363601ca-548e-4266-93ba-cbc3be41d5be
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:58 user nova-compute[75621]: INFO nova.virt.block_device [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attempting to driver detach volume 363601ca-548e-4266-93ba-cbc3be41d5be from mountpoint /dev/vdb
Nov 27 23:13:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Attempting to detach device vdb from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:13:58 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:58 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:13:58 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:13:58 user nova-compute[75621]:   <serial>363601ca-548e-4266-93ba-cbc3be41d5be</serial>
Nov 27 23:13:58 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:13:58 user nova-compute[75621]: </disk>
Nov 27 23:13:58 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:13:58 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdb from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the persistent domain config.
Nov 27 23:13:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:13:58 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:13:58 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:13:58 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:13:58 user nova-compute[75621]:   <serial>363601ca-548e-4266-93ba-cbc3be41d5be</serial>
Nov 27 23:13:58 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:13:58 user nova-compute[75621]: </disk>
Nov 27 23:13:58 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:13:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:14:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:14:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:02 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=6992MB free_disk=24.852909088134766GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b637ed1f-2fc0-4484-b721-850dca879491 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 993ba2a7-2dc0-46f2-8fff-45395e01e340 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8808143-079a-4d07-8b4b-1f76a875b6f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:14:02 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:04 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:14:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [{"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b637ed1f-2fc0-4484-b721-850dca879491" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:08 user nova-compute[75621]: INFO nova.compute.manager [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Terminating instance
Nov 27 23:14:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:08 user nova-compute[75621]: INFO nova.compute.manager [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Terminating instance
Nov 27 23:14:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-99d7f06a-9fac-4c82-8cc8-4e32bafae9a2 req-2bff976a-4f47-4e4f-9968-6980e141a7fd service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-unplugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Instance destroyed successfully.
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'resources' on Instance uuid 993ba2a7-2dc0-46f2-8fff-45395e01e340 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1967555061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1967555061',id=22,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjFmWjrV/uV4RjnK4/QTWN3j4patv1h4FdIT8+U3PAhRRGxNdu9C6Ov1gP/640O+qsHILAi5acywQgBhIywJQtZJLfkhQH/aThAmLWzZEy45f+Tgc0FjzZKXiak5IepuQ==',key_name='tempest-keypair-131461733',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-jbxdipyh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=993ba2a7-2dc0-46f2-8fff-45395e01e340,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "address": "fa:16:3e:51:7f:cd", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapad192969-9c", "ovs_interfaceid": "ad192969-9c6d-4db8-b6cb-02f7ca696616", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG os_vif [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapad192969-9c, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=491844ac-6f54-4ae5-a567-4e96bca78aa1) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: INFO os_vif [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:7f:cd,bridge_name='br-int',has_traffic_filtering=True,id=ad192969-9c6d-4db8-b6cb-02f7ca696616,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapad192969-9c')
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Deleting instance files /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340_del
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Deletion of /opt/stack/data/nova/instances/993ba2a7-2dc0-46f2-8fff-45395e01e340_del complete
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-unplugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] No waiting events found dispatching network-vif-unplugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-5dd3164d-c999-4885-8b12-934887708b4a req-5049a5e3-82ec-4ec4-ba2e-c31c94cf6416 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-unplugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.compute.manager [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Instance destroyed successfully.
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.objects.instance [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lazy-loading 'resources' on Instance uuid b637ed1f-2fc0-4484-b721-850dca879491 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1456105911',display_name='tempest-SnapshotDataIntegrityTests-server-1456105911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1456105911',id=21,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ7LiXvXuUzqsfs+X3sQ8+0VsKAAr4eL4d1dciMyKUdoHvEjY0qyBMeIsFuLSmbNYVDNgMduXNlLpD3fBy2hJD7bGazJNj/SF2+jz15D1zNznB2y2zRgDRPqvxpVPnDGCA==',key_name='tempest-keypair-196173175',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:07:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ec921f4d672434cb443a0260fa2eef8',ramdisk_id='',reservation_id='r-6j8nan63',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-863184707',owner_user_name='tempest-SnapshotDataIntegrityTests-863184707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13a84f0a4b3a43b4a68efc24f8d561e7',uuid=b637ed1f-2fc0-4484-b721-850dca879491,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converting VIF {"id": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "address": "fa:16:3e:59:85:77", "network": {"id": "248be604-ac24-4de3-a662-776702384550", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-414849175-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ec921f4d672434cb443a0260fa2eef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45ef4e4b-57", "ovs_interfaceid": "45ef4e4b-57a2-45dd-97d4-a9d41fcf159c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG os_vif [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45ef4e4b-57, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c26ccc01-258f-4e6a-b495-4f4ac8b570fa) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:09 user nova-compute[75621]: INFO os_vif [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:85:77,bridge_name='br-int',has_traffic_filtering=True,id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c,network=Network(248be604-ac24-4de3-a662-776702384550),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45ef4e4b-57')
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Deleting instance files /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491_del
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Deletion of /opt/stack/data/nova/instances/b637ed1f-2fc0-4484-b721-850dca879491_del complete
Nov 27 23:14:09 user nova-compute[75621]: INFO nova.compute.manager [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 27 23:14:09 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:14:09 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:14:10 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:10 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Took 0.90 seconds to deallocate network for instance.
Nov 27 23:14:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-b72c97a3-a3be-4c6a-ad55-4236c10bcab3 req-782e4b55-d6eb-41de-8c26-e2dab899a9d4 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-deleted-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:10 user nova-compute[75621]: INFO nova.compute.manager [req-b72c97a3-a3be-4c6a-ad55-4236c10bcab3 req-782e4b55-d6eb-41de-8c26-e2dab899a9d4 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Neutron deleted interface 45ef4e4b-57a2-45dd-97d4-a9d41fcf159c; detaching it from the instance and deleting it from the info cache
Nov 27 23:14:10 user nova-compute[75621]: DEBUG nova.network.neutron [req-b72c97a3-a3be-4c6a-ad55-4236c10bcab3 req-782e4b55-d6eb-41de-8c26-e2dab899a9d4 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-b72c97a3-a3be-4c6a-ad55-4236c10bcab3 req-782e4b55-d6eb-41de-8c26-e2dab899a9d4 service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Detach interface failed, port_id=45ef4e4b-57a2-45dd-97d4-a9d41fcf159c, reason: Instance b637ed1f-2fc0-4484-b721-850dca879491 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:14:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:10 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:10 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Took 1.39 seconds to deallocate network for instance.
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] Acquiring lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] No waiting events found dispatching network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:11 user nova-compute[75621]: WARNING nova.compute.manager [req-5ab6d655-a53a-4036-b34a-dc9730c8f42b req-1ad00659-f03a-438e-bef9-019c9da5f161 service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received unexpected event network-vif-plugged-ad192969-9c6d-4db8-b6cb-02f7ca696616 for instance with vm_state deleted and task_state None.
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.objects.instance [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.371s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Deleted allocations for instance b637ed1f-2fc0-4484-b721-850dca879491
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-30278943-29bb-4796-91ac-68e6d9886030 tempest-SnapshotDataIntegrityTests-863184707 tempest-SnapshotDataIntegrityTests-863184707-project-member] Lock "b637ed1f-2fc0-4484-b721-850dca879491" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.540s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] Acquiring lock "b637ed1f-2fc0-4484-b721-850dca879491-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] Lock "b637ed1f-2fc0-4484-b721-850dca879491-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] No waiting events found dispatching network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:11 user nova-compute[75621]: WARNING nova.compute.manager [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] [instance: b637ed1f-2fc0-4484-b721-850dca879491] Received unexpected event network-vif-plugged-45ef4e4b-57a2-45dd-97d4-a9d41fcf159c for instance with vm_state deleted and task_state None.
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-30c3ae18-88b0-4b6c-bcc7-52c0fa44eb10 req-a8b16426-11a7-407d-8aa3-84322cb12e8f service nova] [instance: 993ba2a7-2dc0-46f2-8fff-45395e01e340] Received event network-vif-deleted-ad192969-9c6d-4db8-b6cb-02f7ca696616 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:11 user nova-compute[75621]: INFO nova.compute.manager [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Attaching volume 7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 to /dev/vdb
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.utils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17476109-ee27-46c3-890a-94a0ec30f3d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17560c8a-ae56-400d-8aa2-a06b5d25c191]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bf871c-4872-4c31-83aa-608b88283d04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c6159c-aa78-4ee7-84c6-3baefebc8a0d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:14:11 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9140a4-8cb7-4433-9492-e5301db19de7]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG os_brick.utils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating existing volume attachment record: f4a7dd3c-c31d-46b9-8866-5dbbf2aa68a3 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.526s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:11 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Deleted allocations for instance 993ba2a7-2dc0-46f2-8fff-45395e01e340
Nov 27 23:14:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ed8f086e-3ab6-4495-83b1-d2547837d709 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "993ba2a7-2dc0-46f2-8fff-45395e01e340" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.466s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing instance network info cache due to event network-changed-5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG nova.network.neutron [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Refreshing network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG nova.network.neutron [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated VIF entry in instance network info cache for port 5032c209-fff8-4169-bf18-7b6a18a53d1a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG nova.network.neutron [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a207c67c-71ac-44ed-b08f-f00587ddf48e req-a5c917de-dcc2-431e-a9a9-45fcd421ca26 service nova] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Stashing vm_state: active {{(pid=75621) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:14:18 user nova-compute[75621]: INFO nova.compute.claims [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Claim successful on node user
Nov 27 23:14:18 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating resource usage from migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-changed-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Refreshing instance network info cache due to event network-changed-cf6eb519-6256-422e-871e-4dd93ca7711b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Refreshing network info cache for port cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.471s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:18 user nova-compute[75621]: INFO nova.compute.manager [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Migrating
Nov 27 23:14:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updated VIF entry in instance network info cache for port cf6eb519-6256-422e-871e-4dd93ca7711b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:19 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 is timed out.
Nov 27 23:14:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdb from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the live domain config.
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'adKfntWU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ab41fe-0238-4e0e-8be5-49b6049d51f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:14:19 user nova-compute[75621]: No targets found.
Nov 27 23:14:19 user nova-compute[75621]: iSNS:
Nov 27 23:14:19 user nova-compute[75621]: No targets found.
Nov 27 23:14:19 user nova-compute[75621]: STATIC:
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:14:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:19 user nova-compute[75621]: FIRMWARE:
Nov 27 23:14:19 user nova-compute[75621]: No targets found.
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:14:19 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:14:19 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b50440f-bc09-47af-a884-b1f71ff03678 req-16e76a14-4690-44d8-961d-9b1ff30cd012 service nova] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[052d0592-a17a-45d5-9b33-ef6681712616]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ff988b-62a9-4bff-99f7-2ae4f3e679a9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07c1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0164a281-2c85-45ae-a022-7d7484b392f4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db11d1ac-989b-4b4c-9d1e-a455efebda1f]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99213e0d-4925-434d-917c-8769ecb55058]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb358f16-54d3-4160-9c58-25a040048746]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a770a59b-6f8e-4bf4-813b-26de728e21cc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNQtAUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50aef544-69f0-4dfe-b29e-775351a8449a]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260]
Nov 27 23:14:19 user nova-compute[75621]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be, portal: 172.16.0.220,3260] successful.
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:363601ca-548e-4266-93ba-cbc3be41d5be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5976ca69-de3e-48f6-b735-31fb9a3eeb24]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== disconnect_volume: return (386ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.073s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:19 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5c8d76-02ba-43d6-ad3b-8afc2dc96a59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:14:19 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6e1e45-25bd-4dc0-885c-cfb0b62da049]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523] added
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe6682-6b23-4d81-9a96-01feb282b082]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ed9c54-0283-4464-bff2-0e7af546025c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMNQtAUi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMNQtAUi" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f576b99b-23e8-4597-8d11-1863d08e3148]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMNQtAUi'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6970a036-1d98-4d8a-a3ee-a6106c4b116c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a81122-6de2-4809-bebf-62739d0924bf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: INFO nova.compute.manager [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Rescuing
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd4ea4-72dd-46e4-a472-7edca4e75439]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260]
Nov 27 23:14:19 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260] successful.
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Starting migrate_disk_and_power_off {{(pid=75621) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11484}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[26295550-b7a9-4829-b5e1-1088e0954b3f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[433f7ebf-eacc-4677-b705-ff5b0ab2574a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ada1a7-7b45-4eb6-b96b-9d675ddab164]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNQtAUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:14:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:20 user nova-compute[75621]: WARNING nova.compute.manager [req-f35f0ad6-394b-4b34-83f5-5ab83f3de2d4 req-b5fb3c44-e101-4526-99b9-74844ff2d23b service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state active and task_state resize_migrating.
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-aac0a47d-c75d-4de4-a8a9-c409bed00f73 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.905s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance destroyed successfully.
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:14:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf6eb519-62, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d6c6364-0d6a-44ce-8e2d-0271732b042b) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: INFO os_vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62')
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:20 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== connect_volume: return (1463ms) {'type': 'block', 'scsi_wwn': '26537383566663038', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537383566663038', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.248s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3252b4c-9a28-4018-a0f4-51bab0552dc6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:14:20 user nova-compute[75621]: No targets found.
Nov 27 23:14:20 user nova-compute[75621]: iSNS:
Nov 27 23:14:20 user nova-compute[75621]: No targets found.
Nov 27 23:14:20 user nova-compute[75621]: STATIC:
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:14:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:20 user nova-compute[75621]: FIRMWARE:
Nov 27 23:14:20 user nova-compute[75621]: No targets found.
Nov 27 23:14:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:14:20 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:14:20 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:14:20 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:14:20 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:14:20 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:14:20 user nova-compute[75621]:   <serial>7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523</serial>
Nov 27 23:14:20 user nova-compute[75621]: </disk>
Nov 27 23:14:20 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e629f91d-b5ab-44fc-b013-c10225961bca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955daec-9404-495c-a2c8-69aa05aa1bc8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130022c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:14:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd15947b-0fbe-4e80-a9b4-3521b059a9ba]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[68512280-d48e-4249-b44c-c157d1003887]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d77bdde-0151-43cf-b861-03150bb8deef]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c98799-853e-4f6d-8050-dff681584c24]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3100ab60-d572-4ac9-80d4-4dd2df42cdad]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8540dd8c-3981-4d29-b4db-8c3b6fdcd1ed]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]
Nov 27 23:14:21 user nova-compute[75621]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 23:14:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[017eca00-9347-4b2d-8429-34a1b52d0b6b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== disconnect_volume: return (603ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:14:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance destroyed successfully.
Nov 27 23:14:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Attempting a stable device rescue
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:14:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Creating image(s)
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'trusted_certs' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] No VIF found with MAC fa:16:3e:33:a5:70, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:14:21 user nova-compute[75621]: INFO nova.compute.manager [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Detaching volume e93378d4-ce0f-41aa-8fe5-e52053698b52
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "551c71c3480aa886a073f0e5e54509c9bd386869" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "551c71c3480aa886a073f0e5e54509c9bd386869" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:21 user nova-compute[75621]: INFO nova.virt.block_device [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Attempting to driver detach volume e93378d4-ce0f-41aa-8fe5-e52053698b52 from mountpoint /dev/vdc
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Attempting to detach device vdc from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:14:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:14:21 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:14:21 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:14:21 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:14:21 user nova-compute[75621]:   <serial>e93378d4-ce0f-41aa-8fe5-e52053698b52</serial>
Nov 27 23:14:21 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:14:21 user nova-compute[75621]: </disk>
Nov 27 23:14:21 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:22 user nova-compute[75621]: WARNING nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state active and task_state resize_migrating.
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:22 user nova-compute[75621]: WARNING nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state rescuing.
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:22 user nova-compute[75621]: WARNING nova.compute.manager [req-19386981-7de8-4a68-9952-9f09c76468e5 req-36018132-2fc8-4546-a7e3-083519063239 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state rescuing.
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-16f1db92-35d0-412a-8b19-552dfc1b89e3 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.098s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdc from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the persistent domain config.
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:14:22 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:14:22 user nova-compute[75621]:   <source dev="/dev/sdg"/>
Nov 27 23:14:22 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:14:22 user nova-compute[75621]:   <serial>e93378d4-ce0f-41aa-8fe5-e52053698b52</serial>
Nov 27 23:14:22 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:14:22 user nova-compute[75621]: </disk>
Nov 27 23:14:22 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.network.neutron [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Port cf6eb519-6256-422e-871e-4dd93ca7711b binding to destination host user is already ACTIVE {{(pid=75621) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.virt.images [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] c0f81efa-58a3-4f13-b4de-be717a17d589 was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.part /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.part /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.converted" returned: 0 in 0.465s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869.converted --force-share --output=json" returned: 0 in 0.241s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "551c71c3480aa886a073f0e5e54509c9bd386869" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.098s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "551c71c3480aa886a073f0e5e54509c9bd386869" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "551c71c3480aa886a073f0e5e54509c9bd386869" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869 --force-share --output=json" returned: 0 in 0.234s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869,backing_fmt=raw /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG os_brick.utils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869,backing_fmt=raw /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue" returned: 0 in 0.087s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "551c71c3480aa886a073f0e5e54509c9bd386869" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'migration_context' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<89a23062-cf16-4dd9-b6e8-7483115ca1c3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start _get_guest_xml network_info=[{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:21:07:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c0f81efa-58a3-4f13-b4de-be717a17d589', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c3e6897e-b4af-4166-a588-943696680731', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '89a23062-cf16-4dd9-b6e8-7483115ca1c3', 'attached_at': '', 'detached_at': '', 'volume_id': '71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'serial': '71cf7f9a-e2e6-455b-8065-0ecde4d24980'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ce3c79-a7eb-472f-a984-01ccdef71f4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<89a23062-cf16-4dd9-b6e8-7483115ca1c3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'numa_topology' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e963ea7-a8ac-47e2-9641-165e6a238ab9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<89a23062-cf16-4dd9-b6e8-7483115ca1c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:14:23 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:23 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'vcpu_model' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84f3882-f8dc-4646-bd4a-f5adeff101af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa5068d-9678-4310-9d77-bbb08444d97a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:23 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.objects.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<89a23062-cf16-4dd9-b6e8-7483115ca1c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:24 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:24 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:24 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:14:24 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8fbf0-44f3-4d97-8b22-707e44d498d1]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.utils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b9f3df-a5c1-4695-b973-43cdd1886736]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = nLUWJqsi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 27 23:14:24 user nova-compute[75621]: node.name = iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:14:24 user nova-compute[75621]: node.tpgt = -1
Nov 27 23:14:24 user nova-compute[75621]: node.startup = automatic
Nov 27 23:14:24 user nova-compute[75621]: node.leading_login = No
Nov 27 23:14:24 user nova-compute[75621]: iface.iscsi_ifacename = default
Nov 27 23:14:24 user nova-compute[75621]: iface.net_ifacename = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.ipaddress = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.prefix_len = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.hwaddress = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.transport_name = tcp
Nov 27 23:14:24 user nova-compute[75621]: iface.initiatorname = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.vlan_id = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.vlan_priority = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.vlan_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.iface_num = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.mtu = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.port = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.bootproto = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.subnet_mask = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.gateway = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_alt_client_id_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_alt_client_id = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_dns = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_learn_iqn = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_req_vendor_id_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_vendor_id_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_vendor_id = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.dhcp_slp_da = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.fragmentation = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.gratuitous_arp = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.incoming_forwarding = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.tos_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.tos = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.ttl = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.delayed_ack = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.tcp_nagle = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.tcp_wsf_state = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.tcp_wsf = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.tcp_timer_scale = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.tcp_timestamp = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.redirect = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.def_task_mgmt_timeout = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.header_digest = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.data_digest = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.immediate_data = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.initial_r2t = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.data_seq_inorder = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.data_pdu_inorder = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.erl = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.max_receive_data_len = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.first_burst_len = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.max_outstanding_r2t = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.max_burst_len = 0
Nov 27 23:14:24 user nova-compute[75621]: iface.chap_auth = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.bidi_chap = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.strict_login_compliance = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.discovery_auth = <empty>
Nov 27 23:14:24 user nova-compute[75621]: iface.discovery_logout = <empty>
Nov 27 23:14:24 user nova-compute[75621]: node.discovery_address = <empty>
Nov 27 23:14:24 user nova-compute[75621]: node.discovery_port = 0
Nov 27 23:14:24 user nova-compute[75621]: node.discovery_type = static
Nov 27 23:14:24 user nova-compute[75621]: node.session.initial_cmdsn = 0
Nov 27 23:14:24 user nova-compute[75621]: node.session.initial_login_retry_max = 8
Nov 27 23:14:24 user nova-compute[75621]: node.session.xmit_thread_priority = -20
Nov 27 23:14:24 user nova-compute[75621]: node.session.cmds_max = 128
Nov 27 23:14:24 user nova-compute[75621]: node.session.queue_depth = 32
Nov 27 23:14:24 user nova-compute[75621]: node.session.nr_sessions = 1
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.authmethod = CHAP
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.username = nLUWJqsi
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.password = ***
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.username_in = <empty>
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.password_in = <empty>
Nov 27 23:14:24 user nova-compute[75621]: node.session.auth.chap_algs = MD5
Nov 27 23:14:24 user nova-compute[75621]: node.session.timeo.replacement_timeout = 120
Nov 27 23:14:24 user nova-compute[75621]: node.session.err_timeo.abort_timeout = 15
Nov 27 23:14:24 user nova-compute[75621]: node.session.err_timeo.lu_reset_timeout = 30
Nov 27 23:14:24 user nova-compute[75621]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 27 23:14:24 user nova-compute[75621]: node.session.err_timeo.host_reset_timeout = 60
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.FastAbort = Yes
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.InitialR2T = No
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.ImmediateData = Yes
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.FirstBurstLength = 262144
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.MaxBurstLength = 16776192
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.DefaultTime2Retain = 0
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.DefaultTime2Wait = 2
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.MaxConnections = 1
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 27 23:14:24 user nova-compute[75621]: node.session.iscsi.ERL = 0
Nov 27 23:14:24 user nova-compute[75621]: node.session.scan = manual
Nov 27 23:14:24 user nova-compute[75621]: node.session.reopen_max = 0
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].address = 172.16.0.220
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].port = 3260
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].startup = manual
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].tcp.window_size = 524288
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].tcp.type_of_service = 0
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].timeo.logout_timeout = 15
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].timeo.login_timeout = 15
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].timeo.auth_timeout = 45
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].timeo.noop_out_interval = 5
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].timeo.noop_out_timeout = 5
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.HeaderDigest = None
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.DataDigest = None
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.IFMarker = No
Nov 27 23:14:24 user nova-compute[75621]: node.conn[0].iscsi.OFMarker = No
Nov 27 23:14:24 user nova-compute[75621]: # END RECORD
Nov 27 23:14:24 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a31aaf8-24eb-46de-97de-d6c5e5cbc416]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c6e52-3b9a-4649-a82d-db033e344375]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLUWJqsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nLUWJqsi" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6a0a6-c0ec-4b50-bbbc-feaffbd2dff7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nLUWJqsi'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79ec321-0059-4347-88d0-07f1235467e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b33c7f-0d69-4111-8480-a9d28ac2f9e6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:24 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] HCTL ('37', '0', '0', 0) found on session 35 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bd0f5c-8729-4d8b-8b3e-932bdd7ad8c6]: (4, ('0 0 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Searching for a device in session 35 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.192s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== connect_volume: return (193ms) {'type': 'block', 'scsi_wwn': '26534336561303636', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534336561303636', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1098098055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1098098055',id=30,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-002dwlh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:12:50Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=89a23062-cf16-4dd9-b6e8-7483115ca1c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:21:07:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "vif_mac": "fa:16:3e:21:07:4d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'pci_devices' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.objects.base [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Object Instance<89a23062-cf16-4dd9-b6e8-7483115ca1c3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:14:24 user nova-compute[75621]:   <uuid>89a23062-cf16-4dd9-b6e8-7483115ca1c3</uuid>
Nov 27 23:14:24 user nova-compute[75621]:   <name>instance-0000001e</name>
Nov 27 23:14:24 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:14:24 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:14:24 user nova-compute[75621]:   <metadata>
Nov 27 23:14:24 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:14:24 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1098098055</nova:name>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:14:23</nova:creationTime>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:14:24 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:14:24 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:owner>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:user uuid="506743bc2ab54538b400595de8792b5d">tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member</nova:user>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:project uuid="ef81acb6ed764a23a83269df20981c46">tempest-ServerBootFromVolumeStableRescueTest-1640168355</nova:project>
Nov 27 23:14:24 user nova-compute[75621]:       </nova:owner>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:14:24 user nova-compute[75621]:       <nova:ports>
Nov 27 23:14:24 user nova-compute[75621]:         <nova:port uuid="6bc17f22-a156-4844-8a19-a37664ce1d9e">
Nov 27 23:14:24 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:14:24 user nova-compute[75621]:         </nova:port>
Nov 27 23:14:24 user nova-compute[75621]:       </nova:ports>
Nov 27 23:14:24 user nova-compute[75621]:     </nova:instance>
Nov 27 23:14:24 user nova-compute[75621]:   </metadata>
Nov 27 23:14:24 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:14:24 user nova-compute[75621]:     <system>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="serial">89a23062-cf16-4dd9-b6e8-7483115ca1c3</entry>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="uuid">89a23062-cf16-4dd9-b6e8-7483115ca1c3</entry>
Nov 27 23:14:24 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:14:24 user nova-compute[75621]:     </system>
Nov 27 23:14:24 user nova-compute[75621]:   </sysinfo>
Nov 27 23:14:24 user nova-compute[75621]:   <os>
Nov 27 23:14:24 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:14:24 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:14:24 user nova-compute[75621]:   </os>
Nov 27 23:14:24 user nova-compute[75621]:   <features>
Nov 27 23:14:24 user nova-compute[75621]:     <acpi/>
Nov 27 23:14:24 user nova-compute[75621]:     <apic/>
Nov 27 23:14:24 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:14:24 user nova-compute[75621]:   </features>
Nov 27 23:14:24 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:14:24 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:14:24 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:14:24 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:14:24 user nova-compute[75621]:   </clock>
Nov 27 23:14:24 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:14:24 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:14:24 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:14:24 user nova-compute[75621]:   </cpu>
Nov 27 23:14:24 user nova-compute[75621]:   <devices>
Nov 27 23:14:24 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:14:24 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:14:24 user nova-compute[75621]:       <source dev="/dev/sdf"/>
Nov 27 23:14:24 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:14:24 user nova-compute[75621]:       <serial>71cf7f9a-e2e6-455b-8065-0ecde4d24980</serial>
Nov 27 23:14:24 user nova-compute[75621]:     </disk>
Nov 27 23:14:24 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:14:24 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:14:24 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue"/>
Nov 27 23:14:24 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:14:24 user nova-compute[75621]:       <boot order="1"/>
Nov 27 23:14:24 user nova-compute[75621]:     </disk>
Nov 27 23:14:24 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:14:24 user nova-compute[75621]:       <mac address="fa:16:3e:21:07:4d"/>
Nov 27 23:14:24 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:14:24 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:14:24 user nova-compute[75621]:       <target dev="tap6bc17f22-a1"/>
Nov 27 23:14:24 user nova-compute[75621]:     </interface>
Nov 27 23:14:24 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:14:24 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/console.log" append="off"/>
Nov 27 23:14:24 user nova-compute[75621]:     </serial>
Nov 27 23:14:24 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:14:24 user nova-compute[75621]:     <video>
Nov 27 23:14:24 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:14:24 user nova-compute[75621]:     </video>
Nov 27 23:14:24 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:14:24 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:14:24 user nova-compute[75621]:     </rng>
Nov 27 23:14:24 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:14:24 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:14:24 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:14:24 user nova-compute[75621]:     </memballoon>
Nov 27 23:14:24 user nova-compute[75621]:   </devices>
Nov 27 23:14:24 user nova-compute[75621]: </domain>
Nov 27 23:14:24 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:14:24 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance destroyed successfully.
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] No VIF found with MAC fa:16:3e:21:07:4d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing instance network info cache due to event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:24 user nova-compute[75621]: DEBUG nova.network.neutron [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG nova.network.neutron [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updated VIF entry in instance network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG nova.network.neutron [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ff87d3f4-9640-4e2f-ad01-5d2750eacf2a req-a6d653cf-43d2-4d33-b760-524f533934b1 service nova] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:25 user nova-compute[75621]: WARNING nova.compute.manager [req-96ba0d9e-2841-4537-b214-109788a37291 req-5dced92a-5c7a-4eba-bd98-1cfae65e10e7 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state rescuing.
Nov 27 23:14:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:27 user nova-compute[75621]: DEBUG nova.compute.manager [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing instance network info cache due to event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:14:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:27 user nova-compute[75621]: DEBUG nova.network.neutron [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.compute.manager [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:28 user nova-compute[75621]: WARNING nova.compute.manager [req-7b167b5c-eb4b-4c1d-82a0-4fd0d6d3165f req-5915580a-ca3e-462d-b05d-3e84b923e300 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state rescuing.
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-cfa719cf-dd16-4e26-b333-616231610983 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updated VIF entry in instance network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.network.neutron [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-521af173-52cf-4442-9c14-ad8fa2bcaca7 req-bc95b929-d099-4456-9426-5a1497beca4b service nova] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:28 user nova-compute[75621]: INFO nova.compute.manager [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Rebooting instance
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:14:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:14:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:31 user nova-compute[75621]: WARNING nova.compute.manager [req-9c1f872f-1c1b-4fb0-a923-46b4dca6578b req-971f1ff8-6f1b-46ed-87d0-a7817e25768c service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state active and task_state reboot_started.
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Starting finish_migration {{(pid=75621) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11671}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:14:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Creating image(s)
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Ensure instance console log exists: /opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start _get_guest_xml network_info=[{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '0bd8619d-2abd-49c9-8e91-2f3383e42de0', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '203ff896-ed38-4378-9146-075fb92cf657', 'attached_at': '2023-11-27T23:14:32.000000', 'detached_at': '', 'volume_id': 'b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'serial': 'b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:14:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:57Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:32 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:32 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:32 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[622c6140-cb98-4e87-8b4d-a91f2367f905]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:14:32 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[633d5ee4-3c4a-4e94-8984-e5e3a9a7ef44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba] added
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[15124ddb-b102-4290-8252-50efc7a089d0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[744e478d-6a74-477b-b44c-54258ffac03f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsXpHShg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance shutdown successfully.
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsXpHShg" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0425d3-9858-4e9f-b6a1-53197e9f05e4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lsXpHShg'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38462ad5-0fc4-4cf5-939f-ed3ff5e1d80e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cd346f-eea1-4ff9-adbb-0a83f3f47ddb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cbfcb6-1506-4bde-a2de-843c5259b6ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]
Nov 27 23:14:32 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4c1ef1-b046-424d-8bdb-ab7875599967]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257ee88-7059-4b4e-84f2-a3cee7a03817]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:32 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:32 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[14740f72-408b-4251-9fc4-5add70310f13]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:14:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23464623432333634', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464623432333634', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:14:33 user nova-compute[75621]:   <uuid>203ff896-ed38-4378-9146-075fb92cf657</uuid>
Nov 27 23:14:33 user nova-compute[75621]:   <name>instance-0000001d</name>
Nov 27 23:14:33 user nova-compute[75621]:   <memory>2097152</memory>
Nov 27 23:14:33 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:14:33 user nova-compute[75621]:   <metadata>
Nov 27 23:14:33 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:14:33 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:14:33 user nova-compute[75621]:       <nova:name>tempest-ServerActionsTestOtherA-server-1308485278</nova:name>
Nov 27 23:14:33 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:14:32</nova:creationTime>
Nov 27 23:14:33 user nova-compute[75621]:       <nova:flavor name="m1.small">
Nov 27 23:14:33 user nova-compute[75621]:         <nova:memory>2048</nova:memory>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:disk>20</nova:disk>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:14:33 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:14:33 user nova-compute[75621]:       <nova:owner>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:user uuid="d4cbbd5877014527889b23cd592da5f0">tempest-ServerActionsTestOtherA-1166847266-project-member</nova:user>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:project uuid="7af3c98f53504bd39917790819b9bae6">tempest-ServerActionsTestOtherA-1166847266</nova:project>
Nov 27 23:14:33 user nova-compute[75621]:       </nova:owner>
Nov 27 23:14:33 user nova-compute[75621]:       <nova:ports>
Nov 27 23:14:33 user nova-compute[75621]:         <nova:port uuid="cf6eb519-6256-422e-871e-4dd93ca7711b">
Nov 27 23:14:33 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:14:33 user nova-compute[75621]:         </nova:port>
Nov 27 23:14:33 user nova-compute[75621]:       </nova:ports>
Nov 27 23:14:33 user nova-compute[75621]:     </nova:instance>
Nov 27 23:14:33 user nova-compute[75621]:   </metadata>
Nov 27 23:14:33 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:14:33 user nova-compute[75621]:     <system>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="serial">203ff896-ed38-4378-9146-075fb92cf657</entry>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="uuid">203ff896-ed38-4378-9146-075fb92cf657</entry>
Nov 27 23:14:33 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:14:33 user nova-compute[75621]:     </system>
Nov 27 23:14:33 user nova-compute[75621]:   </sysinfo>
Nov 27 23:14:33 user nova-compute[75621]:   <os>
Nov 27 23:14:33 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:14:33 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:14:33 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:14:33 user nova-compute[75621]:   </os>
Nov 27 23:14:33 user nova-compute[75621]:   <features>
Nov 27 23:14:33 user nova-compute[75621]:     <acpi/>
Nov 27 23:14:33 user nova-compute[75621]:     <apic/>
Nov 27 23:14:33 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:14:33 user nova-compute[75621]:   </features>
Nov 27 23:14:33 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:14:33 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:14:33 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:14:33 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:14:33 user nova-compute[75621]:   </clock>
Nov 27 23:14:33 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:14:33 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:14:33 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:14:33 user nova-compute[75621]:   </cpu>
Nov 27 23:14:33 user nova-compute[75621]:   <devices>
Nov 27 23:14:33 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:14:33 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:14:33 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:14:33 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:14:33 user nova-compute[75621]:       <serial>b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba</serial>
Nov 27 23:14:33 user nova-compute[75621]:     </disk>
Nov 27 23:14:33 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:14:33 user nova-compute[75621]:       <mac address="fa:16:3e:6e:13:bf"/>
Nov 27 23:14:33 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:14:33 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:14:33 user nova-compute[75621]:       <target dev="tapcf6eb519-62"/>
Nov 27 23:14:33 user nova-compute[75621]:     </interface>
Nov 27 23:14:33 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:14:33 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657/console.log" append="off"/>
Nov 27 23:14:33 user nova-compute[75621]:     </serial>
Nov 27 23:14:33 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:14:33 user nova-compute[75621]:     <video>
Nov 27 23:14:33 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:14:33 user nova-compute[75621]:     </video>
Nov 27 23:14:33 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:14:33 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:14:33 user nova-compute[75621]:     </rng>
Nov 27 23:14:33 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:14:33 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:14:33 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:14:33 user nova-compute[75621]:     </memballoon>
Nov 27 23:14:33 user nova-compute[75621]:   </devices>
Nov 27 23:14:33 user nova-compute[75621]: </domain>
Nov 27 23:14:33 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-781523245-network", "vif_mac": "fa:16:3e:6e:13:bf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG os_vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff51dc1-1746-569f-b0ce-b422d765e6f3', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf6eb519-62, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf6eb519-62, col_values=(('qos', UUID('b3ab77ab-151e-4115-84ae-aae47632f900')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf6eb519-62, col_values=(('external_ids', {'iface-id': 'cf6eb519-6256-422e-871e-4dd93ca7711b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:13:bf', 'vm-uuid': '203ff896-ed38-4378-9146-075fb92cf657'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: INFO os_vif [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62')
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] No VIF found with MAC fa:16:3e:6e:13:bf, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:33 user nova-compute[75621]: WARNING nova.compute.manager [req-1ebdd2ef-9789-46b9-a0f0-5d4f7232bc40 req-cfeec2a3-e02c-4d98-a49b-9b882b6eba11 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state active and task_state reboot_started.
Nov 27 23:14:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:35 user nova-compute[75621]: WARNING nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state active and task_state reboot_started.
Nov 27 23:14:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:35 user nova-compute[75621]: WARNING nova.compute.manager [req-72b3aecf-5033-4211-aa36-cdd0c527f6ca req-a7e6a2a4-127e-4244-9c38-10d05ccaf4e5 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state active and task_state reboot_started.
Nov 27 23:14:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:36 user nova-compute[75621]: WARNING nova.compute.manager [req-631a0963-a9e6-4f04-9a2b-2c18b9655ae2 req-038e9465-17b9-418b-bb67-fc60b2bc8974 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state active and task_state resize_finish.
Nov 27 23:14:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance running successfully.
Nov 27 23:14:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance soft rebooted successfully.
Nov 27 23:14:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:14:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-07f0e8f9-6c43-49b4-9c44-877e9aaa9c75 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.303s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:38 user nova-compute[75621]: WARNING nova.compute.manager [req-c5c6cbcf-8f5d-41d5-a79b-9edbb42f5fe4 req-9f30fb11-5c47-4399-bcfc-13cc2cb60534 service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state active and task_state resize_finish.
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:14:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance running successfully.
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Failed to set time: agent not configured {{(pid=75621) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-15f3ff3d-9f6e-4661-ac4e-9477806011e3 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] finish_migration finished successfully. {{(pid=75621) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11766}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-changed-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Refreshing instance network info cache due to event network-changed-68b73255-f1eb-457b-b38e-6b5b75196004. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] Acquiring lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] Acquired lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Refreshing network info cache for port 68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:38 user nova-compute[75621]: INFO nova.compute.manager [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Terminating instance
Nov 27 23:14:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updated VIF entry in instance network info cache for port 68b73255-f1eb-457b-b38e-6b5b75196004. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updating instance_info_cache with network_info: [{"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83181c5f-366e-4d4a-b25d-617b33a3b9d8 req-5944ea9e-5302-4ae3-877a-6752d79d2a34 service nova] Releasing lock "refresh_cache-b8808143-079a-4d07-8b4b-1f76a875b6f7" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Instance destroyed successfully.
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'resources' on Instance uuid b8808143-079a-4d07-8b4b-1f76a875b6f7 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2003661644',display_name='tempest-AttachVolumeNegativeTest-server-2003661644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2003661644',id=31,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDJkchusOkvRvSQmZBFKmoSY0hh45CHBfZhTqEfLAyYPHfhBbv7A4Zdq+fCZIpCA6w6t8c17qH90MK48qFBXcbycvrBi9APdMErNyQu8tM++ThEvmQHl59+NBS1I7vDKVw==',key_name='tempest-keypair-456027875',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-p1umaqbi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:12:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=b8808143-079a-4d07-8b4b-1f76a875b6f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "68b73255-f1eb-457b-b38e-6b5b75196004", "address": "fa:16:3e:ac:0d:6d", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b73255-f1", "ovs_interfaceid": "68b73255-f1eb-457b-b38e-6b5b75196004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG os_vif [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b73255-f1, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45b3e3bf-ae19-4e60-a834-db609d11e59a) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:39 user nova-compute[75621]: INFO os_vif [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:0d:6d,bridge_name='br-int',has_traffic_filtering=True,id=68b73255-f1eb-457b-b38e-6b5b75196004,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b73255-f1')
Nov 27 23:14:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Deleting instance files /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7_del
Nov 27 23:14:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Deletion of /opt/stack/data/nova/instances/b8808143-079a-4d07-8b4b-1f76a875b6f7_del complete
Nov 27 23:14:39 user nova-compute[75621]: INFO nova.compute.manager [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 27 23:14:39 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:14:39 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-unplugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] No waiting events found dispatching network-vif-unplugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-unplugged-68b73255-f1eb-457b-b38e-6b5b75196004 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Acquiring lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] No waiting events found dispatching network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:40 user nova-compute[75621]: WARNING nova.compute.manager [req-27cc3c46-c8f1-4dfc-9f75-8effd37a3225 req-df423c49-d959-4e5d-84aa-dbd6642cea58 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received unexpected event network-vif-plugged-68b73255-f1eb-457b-b38e-6b5b75196004 for instance with vm_state active and task_state deleting.
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:40 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Took 0.92 seconds to deallocate network for instance.
Nov 27 23:14:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-c749fdc3-d88a-4fd1-8bf1-fc4d3ede927b req-583587e0-bddb-453c-a2de-a47ca8940c27 service nova] [instance: b8808143-079a-4d07-8b4b-1f76a875b6f7] Received event network-vif-deleted-68b73255-f1eb-457b-b38e-6b5b75196004 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:41 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:41 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:41 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Deleted allocations for instance b8808143-079a-4d07-8b4b-1f76a875b6f7
Nov 27 23:14:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-50cece67-19f3-4346-8edc-7cb28a9fa1ab tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "b8808143-079a-4d07-8b4b-1f76a875b6f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.715s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:43 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 is timed out.
Nov 27 23:14:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully detached device vdc from instance de02eaf0-a5ee-4514-8ccd-53e92766ee05 from the live domain config.
Nov 27 23:14:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'suvZzwBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:14:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d8c0d6-79f0-4c62-8401-8d7ad9755735]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:14:43 user nova-compute[75621]: No targets found.
Nov 27 23:14:43 user nova-compute[75621]: iSNS:
Nov 27 23:14:43 user nova-compute[75621]: No targets found.
Nov 27 23:14:43 user nova-compute[75621]: STATIC:
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:14:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:14:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:14:43 user nova-compute[75621]: FIRMWARE:
Nov 27 23:14:43 user nova-compute[75621]: No targets found.
Nov 27 23:14:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:14:43 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:14:43 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f068d71a-9479-4e59-8399-cf33ee3a3164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3469c8-9f2a-4bb9-b17b-655c961734f9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:14:43 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:14:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07c3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52'): ({'sdg'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Removing single pathed devices sdg {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee92c9d1-4a66-4ef6-8966-aa7902b887bf]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9935939-275e-4513-ac85-b18a1213447c]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Flushing IO for device /dev/sdg {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea951239-2d0e-4846-854f-7f676d90a887]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac7b9ac-5747-4592-bcf2-4a9c37775118]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] SCSI volumes sdg have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e29d5d-1f27-4948-a30a-75543e3462c4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d3425d-fcc0-44df-810b-106d03c76b49]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260]
Nov 27 23:14:43 user nova-compute[75621]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52, portal: 172.16.0.220,3260] successful.
Nov 27 23:14:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e93378d4-ce0f-41aa-8fe5-e52053698b52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86460d04-85eb-46c1-a401-0e230b304231]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] <== disconnect_volume: return (412ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:14:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'flavor' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4835ed18-5cf5-48a3-b76c-5f6f07f8e319 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.110s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:45 user nova-compute[75621]: INFO nova.compute.manager [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Terminating instance
Nov 27 23:14:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-unplugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] No waiting events found dispatching network-vif-unplugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-19a0f1b7-7608-4c37-83b4-7138871c7ce7 req-c5f52af6-6ea8-4ad5-8c7b-ba189e2ed1b1 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-unplugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:14:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Instance destroyed successfully.
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.objects.instance [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lazy-loading 'resources' on Instance uuid de02eaf0-a5ee-4514-8ccd-53e92766ee05 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:11:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-273773289',display_name='tempest-AttachVolumeTestJSON-server-273773289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-273773289',id=27,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkznY3LvKpvwmI8ktCuxS/qaPcZv9Ia3g8H9XGhmuJJjFHbrd83dRF+mx2eKytCTXaWbWYiCKHIqJBuvIVxL5ZXf5JhxVafdK6AJulQvBFONzrPrI2tn/x0DbwvMU72zA==',key_name='tempest-keypair-435421617',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:11:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea584e6a3e6b441d8fdec3f91a1c23ed',ramdisk_id='',reservation_id='r-wfv7y97s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1955560544',owner_user_name='tempest-AttachVolumeTestJSON-1955560544-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cc5cf604fbfd4f1dbdbe80b05f540425',uuid=de02eaf0-a5ee-4514-8ccd-53e92766ee05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converting VIF {"id": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "address": "fa:16:3e:42:1a:5f", "network": {"id": "d651d602-e4cf-4036-985a-6d5ff4ccdcf0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2111760860-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.186", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea584e6a3e6b441d8fdec3f91a1c23ed", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape449eb71-f3", "ovs_interfaceid": "e449eb71-f371-4604-afd1-e19f0c9cc7e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG os_vif [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape449eb71-f3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d35445b-56ed-4c35-9f95-f595d44317c7) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:46 user nova-compute[75621]: INFO os_vif [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:1a:5f,bridge_name='br-int',has_traffic_filtering=True,id=e449eb71-f371-4604-afd1-e19f0c9cc7e8,network=Network(d651d602-e4cf-4036-985a-6d5ff4ccdcf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape449eb71-f3')
Nov 27 23:14:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Deleting instance files /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05_del
Nov 27 23:14:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Deletion of /opt/stack/data/nova/instances/de02eaf0-a5ee-4514-8ccd-53e92766ee05_del complete
Nov 27 23:14:46 user nova-compute[75621]: INFO nova.compute.manager [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 27 23:14:46 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:14:46 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:14:47 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:47 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Took 0.97 seconds to deallocate network for instance.
Nov 27 23:14:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] Acquiring lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] No waiting events found dispatching network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:48 user nova-compute[75621]: WARNING nova.compute.manager [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received unexpected event network-vif-plugged-e449eb71-f371-4604-afd1-e19f0c9cc7e8 for instance with vm_state deleted and task_state None.
Nov 27 23:14:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-6c0ed95e-157d-46c0-bdb7-bd56f5e007ea req-c23e0cfb-3af8-499d-a56d-a8c2d682cfe4 service nova] [instance: de02eaf0-a5ee-4514-8ccd-53e92766ee05] Received event network-vif-deleted-e449eb71-f371-4604-afd1-e19f0c9cc7e8 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:48 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Deleted allocations for instance de02eaf0-a5ee-4514-8ccd-53e92766ee05
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-78ba733d-876e-45d1-a421-27ccef096ab6 tempest-AttachVolumeTestJSON-1955560544 tempest-AttachVolumeTestJSON-1955560544-project-member] Lock "de02eaf0-a5ee-4514-8ccd-53e92766ee05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.517s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:50 user nova-compute[75621]: INFO nova.compute.manager [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Unrescuing
Nov 27 23:14:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:14:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:14:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'flavor' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:51 user nova-compute[75621]: WARNING nova.compute.manager [req-aae0c5b5-ea44-411e-a230-487534870abb req-34dd96d2-dbac-4bcc-815a-85b4e964f84a service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:14:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance destroyed successfully.
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:53 user nova-compute[75621]: WARNING nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:53 user nova-compute[75621]: WARNING nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:14:53 user nova-compute[75621]: WARNING nova.compute.manager [req-43b830e7-0922-446b-8264-fea853586e08 req-06dcce22-cda1-4ee0-bb4d-317e5e6884ed service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:14:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5d4e62a4-9a37-4f56-8f9c-a914df2202ec tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:14:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:14:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:00 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:03 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:15:03 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:15:03 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7655MB free_disk=24.854007720947266GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Applying migration context for instance 203ff896-ed38-4378-9146-075fb92cf657 as it has an incoming, in-progress migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a. Migration status is finished {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 23:15:04 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating resource usage from migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.551s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:15:04 user nova-compute[75621]: INFO nova.compute.claims [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Claim successful on node user
Nov 27 23:15:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.788s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:15:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.policy [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5427c1c08da34bfead47d98f813db775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37829e68e182457e8df131abcebd5606', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:15:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Creating image(s)
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.203s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Cannot resize image /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Successfully created port: a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:15:07 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:15:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:15:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Successfully updated port: a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing instance network info cache due to event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance network_info: |[{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.neutron [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start _get_guest_xml network_info=[{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:15:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:15:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFET04Pr4JasiQs0bEYmtK0++Dj80KCh7ZsPwryHdlNYA/AKOTcE3TOJqbKBil0AZN45judq2NOFk02C1/wxdXKHPYWpAkgZYOJZBR5JFEbI7EGa1enDsOzISAIQdAfmA==',key_name='tempest-keypair-905213494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:15:08 user nova-compute[75621]:   <uuid>7b4dc389-1c65-4b86-827a-fc8d6bab644c</uuid>
Nov 27 23:15:08 user nova-compute[75621]:   <name>instance-00000020</name>
Nov 27 23:15:08 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:15:08 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:15:08 user nova-compute[75621]:   <metadata>
Nov 27 23:15:08 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:15:08 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1220194247</nova:name>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:15:08</nova:creationTime>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:15:08 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:15:08 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:owner>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:user uuid="5427c1c08da34bfead47d98f813db775">tempest-AttachVolumeShelveTestJSON-355781585-project-member</nova:user>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:project uuid="37829e68e182457e8df131abcebd5606">tempest-AttachVolumeShelveTestJSON-355781585</nova:project>
Nov 27 23:15:08 user nova-compute[75621]:       </nova:owner>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:15:08 user nova-compute[75621]:       <nova:ports>
Nov 27 23:15:08 user nova-compute[75621]:         <nova:port uuid="a6651aae-e6ab-4ed2-b317-61ce769e64b2">
Nov 27 23:15:08 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:15:08 user nova-compute[75621]:         </nova:port>
Nov 27 23:15:08 user nova-compute[75621]:       </nova:ports>
Nov 27 23:15:08 user nova-compute[75621]:     </nova:instance>
Nov 27 23:15:08 user nova-compute[75621]:   </metadata>
Nov 27 23:15:08 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:15:08 user nova-compute[75621]:     <system>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="serial">7b4dc389-1c65-4b86-827a-fc8d6bab644c</entry>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="uuid">7b4dc389-1c65-4b86-827a-fc8d6bab644c</entry>
Nov 27 23:15:08 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:15:08 user nova-compute[75621]:     </system>
Nov 27 23:15:08 user nova-compute[75621]:   </sysinfo>
Nov 27 23:15:08 user nova-compute[75621]:   <os>
Nov 27 23:15:08 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:15:08 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:15:08 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:15:08 user nova-compute[75621]:   </os>
Nov 27 23:15:08 user nova-compute[75621]:   <features>
Nov 27 23:15:08 user nova-compute[75621]:     <acpi/>
Nov 27 23:15:08 user nova-compute[75621]:     <apic/>
Nov 27 23:15:08 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:15:08 user nova-compute[75621]:   </features>
Nov 27 23:15:08 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:15:08 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:15:08 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:15:08 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:15:08 user nova-compute[75621]:   </clock>
Nov 27 23:15:08 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:15:08 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:15:08 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:15:08 user nova-compute[75621]:   </cpu>
Nov 27 23:15:08 user nova-compute[75621]:   <devices>
Nov 27 23:15:08 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:15:08 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:15:08 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk"/>
Nov 27 23:15:08 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:15:08 user nova-compute[75621]:     </disk>
Nov 27 23:15:08 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:15:08 user nova-compute[75621]:       <mac address="fa:16:3e:3c:cf:64"/>
Nov 27 23:15:08 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:15:08 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:15:08 user nova-compute[75621]:       <target dev="tapa6651aae-e6"/>
Nov 27 23:15:08 user nova-compute[75621]:     </interface>
Nov 27 23:15:08 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:15:08 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/console.log" append="off"/>
Nov 27 23:15:08 user nova-compute[75621]:     </serial>
Nov 27 23:15:08 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:15:08 user nova-compute[75621]:     <video>
Nov 27 23:15:08 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:15:08 user nova-compute[75621]:     </video>
Nov 27 23:15:08 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:15:08 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:15:08 user nova-compute[75621]:     </rng>
Nov 27 23:15:08 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:15:08 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:15:08 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:15:08 user nova-compute[75621]:     </memballoon>
Nov 27 23:15:08 user nova-compute[75621]:   </devices>
Nov 27 23:15:08 user nova-compute[75621]: </domain>
Nov 27 23:15:08 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFET04Pr4JasiQs0bEYmtK0++Dj80KCh7ZsPwryHdlNYA/AKOTcE3TOJqbKBil0AZN45judq2NOFk02C1/wxdXKHPYWpAkgZYOJZBR5JFEbI7EGa1enDsOzISAIQdAfmA==',key_name='tempest-keypair-905213494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG os_vif [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e24106b-686b-522d-a420-54d27b6c27cf', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6651aae-e6, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6651aae-e6, col_values=(('qos', UUID('bcaa4574-9af5-4ff3-b38a-83ddca5f7ace')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6651aae-e6, col_values=(('external_ids', {'iface-id': 'a6651aae-e6ab-4ed2-b317-61ce769e64b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:cf:64', 'vm-uuid': '7b4dc389-1c65-4b86-827a-fc8d6bab644c'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:08 user nova-compute[75621]: INFO os_vif [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6')
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No VIF found with MAC fa:16:3e:3c:cf:64, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:15:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updated VIF entry in instance network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:15:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:15:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da222f18-1dfd-48ff-b9c5-b8f916476538 req-cd286e38-ad53-4d35-818d-dae6b0d344dc service nova] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:15:10 user nova-compute[75621]: WARNING nova.compute.manager [req-03f55b7d-10db-4c8a-92cf-789b5c166cd7 req-914fa04b-98ae-48b7-a960-732add6d0d63 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state building and task_state spawning.
Nov 27 23:15:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:15:12 user nova-compute[75621]: WARNING nova.compute.manager [req-0555dd63-fa30-4b86-9ff3-0782bd5ceddc req-15d30439-b127-4f26-bddc-f6cddcce0acd service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state building and task_state spawning.
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:15:12 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance spawned successfully.
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:15:12 user nova-compute[75621]: INFO nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Took 7.29 seconds to spawn the instance on the hypervisor.
Nov 27 23:15:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:15:12 user nova-compute[75621]: INFO nova.compute.manager [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Took 9.03 seconds to build instance.
Nov 27 23:15:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76d14e57-272a-4fc4-80b0-56f764f59958 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.152s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:15:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:15:30 user nova-compute[75621]: INFO nova.compute.manager [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Detaching volume 78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:15:30 user nova-compute[75621]: INFO nova.virt.block_device [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Attempting to driver detach volume 78e79404-92e4-41a9-be66-cbb127b8164b from mountpoint /dev/vdb
Nov 27 23:15:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Attempting to detach device vdb from instance 144ce759-4144-4606-8a2d-90034d7f9129 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:15:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:15:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:15:30 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:15:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:15:30 user nova-compute[75621]:   <serial>78e79404-92e4-41a9-be66-cbb127b8164b</serial>
Nov 27 23:15:30 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:15:30 user nova-compute[75621]: </disk>
Nov 27 23:15:30 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:15:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance 144ce759-4144-4606-8a2d-90034d7f9129 from the persistent domain config.
Nov 27 23:15:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 144ce759-4144-4606-8a2d-90034d7f9129 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:15:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:15:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:15:30 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:15:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:15:30 user nova-compute[75621]:   <serial>78e79404-92e4-41a9-be66-cbb127b8164b</serial>
Nov 27 23:15:30 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:15:30 user nova-compute[75621]: </disk>
Nov 27 23:15:30 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:15:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:15:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 144ce759-4144-4606-8a2d-90034d7f9129 is timed out.
Nov 27 23:15:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance 144ce759-4144-4606-8a2d-90034d7f9129 from the live domain config.
Nov 27 23:15:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qTBXdcFf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:15:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ead852-67d1-4320-8243-8b61695ce077]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:15:50 user nova-compute[75621]: No targets found.
Nov 27 23:15:50 user nova-compute[75621]: iSNS:
Nov 27 23:15:50 user nova-compute[75621]: No targets found.
Nov 27 23:15:50 user nova-compute[75621]: STATIC:
Nov 27 23:15:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:15:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:15:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:15:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523
Nov 27 23:15:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:15:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:15:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b
Nov 27 23:15:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:15:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:15:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:15:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:15:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:15:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:15:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:15:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:15:50 user nova-compute[75621]: FIRMWARE:
Nov 27 23:15:50 user nova-compute[75621]: No targets found.
Nov 27 23:15:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:15:50 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:15:50 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79754aa0-748e-4406-b55a-a6a668486d60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fc15f8-ef2a-46a0-99f0-ba61202d61f0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:15:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:15:50 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:15:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0783880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a98b98-dc98-4b85-af81-961c10b40386]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cf1e27-581f-404e-9d27-12733d3b0b0e]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[004f2ec1-989b-4a1f-96da-715cf2e118cd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55fa9a-3b06-4d70-9dee-ba39f50bc758]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2f17c-f0bd-4889-8fba-bf717ff6be3b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30692dd-7817-4f1e-8b18-0decccce30b7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260]
Nov 27 23:15:50 user nova-compute[75621]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b, portal: 172.16.0.220,3260] successful.
Nov 27 23:15:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:78e79404-92e4-41a9-be66-cbb127b8164b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2817fd3-2c1b-4855-94c1-4d47b9c27878]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== disconnect_volume: return (341ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:15:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:15:51 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:15:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b86b015e-32b2-417e-96e7-8ef67f9c70b1 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.865s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:15:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:54 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:15:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:15:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:16:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:00 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:16:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:16:05 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:16:05 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7557MB free_disk=24.81147003173828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Applying migration context for instance 203ff896-ed38-4378-9146-075fb92cf657 as it has an incoming, in-progress migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a. Migration status is finished {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 27 23:16:05 user nova-compute[75621]: INFO nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating resource usage from migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 144ce759-4144-4606-8a2d-90034d7f9129 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:16:05 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:16:06 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:16:06 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:16:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Going to confirm migration 2 {{(pid=75621) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquired lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'info_cache' on Instance uuid 203ff896-ed38-4378-9146-075fb92cf657 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [{"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Releasing lock "refresh_cache-203ff896-ed38-4378-9146-075fb92cf657" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'migration_context' on Instance uuid 203ff896-ed38-4378-9146-075fb92cf657 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG nova.objects.base [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Object Instance<203ff896-ed38-4378-9146-075fb92cf657> lazy-loaded attributes: info_cache,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:09 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:16:09 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:16:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.531s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:09 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Deleted allocation for migration 91bd9fac-bde9-44ee-81b8-5a04cbef046a
Nov 27 23:16:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-79ee263f-329d-4d0a-9c72-b57b6652a493 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.700s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:10 user nova-compute[75621]: INFO nova.compute.manager [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Unrescuing
Nov 27 23:16:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquired lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:10 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:16:10 user nova-compute[75621]: DEBUG nova.network.neutron [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [{"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Releasing lock "refresh_cache-89a23062-cf16-4dd9-b6e8-7483115ca1c3" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'flavor' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:11 user nova-compute[75621]: WARNING nova.compute.manager [req-91ed3353-58ed-4436-aa33-ea4596a4850e req-e99e5476-2bfe-45a4-8ae1-e68e71da355a service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:16:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance destroyed successfully.
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:13 user nova-compute[75621]: WARNING nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:16:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:13 user nova-compute[75621]: WARNING nova.compute.manager [req-f7c58f6d-47db-4d66-b71a-22c194c7e94a req-2b60682f-0067-41b6-9466-ccdc367039a6 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:16:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-4e3099a3-96f8-42a3-b627-d1cbd88b356b tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG nova.compute.manager [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:15 user nova-compute[75621]: DEBUG nova.compute.manager [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:15 user nova-compute[75621]: WARNING nova.compute.manager [req-93966c8a-7aa9-4b10-9e4b-42b0c3c716b8 req-5079b216-896c-4dfc-bdb8-240d7e4f5a03 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state None.
Nov 27 23:16:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:20 user nova-compute[75621]: INFO nova.compute.manager [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Terminating instance
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing instance network info cache due to event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-unplugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] No waiting events found dispatching network-vif-unplugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-e1015c20-1c80-417e-b90c-8a1cde8524f0 req-20e9d752-bfa5-4817-af1e-5c5d9e98913b service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-unplugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updated VIF entry in instance network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40b885be-bdbc-46e9-9d03-a8223b16b9ef req-1bd5fdc4-2354-40aa-bdc4-dfc32fa2577a service nova] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Instance destroyed successfully.
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'resources' on Instance uuid 144ce759-4144-4606-8a2d-90034d7f9129 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-11995816',display_name='tempest-AttachVolumeNegativeTest-server-11995816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-11995816',id=26,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAYlP9gOsQrx15YDeP9yMNpDjcN++cT/seRssNMRres5iTpjUrdaGDDXA36tFADUVlMUOSnrzrU7SHlvY+29XncnkSeS5k86gB7ki9CZJi1XV/rnYSjqzHUGUZEZfvhOvg==',key_name='tempest-keypair-1495962700',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:10:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-pxct34bi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:10:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=144ce759-4144-4606-8a2d-90034d7f9129,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "address": "fa:16:3e:91:f1:17", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93c55381-bf", "ovs_interfaceid": "93c55381-bfcc-436d-aa32-9a0f4ee3e6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG os_vif [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93c55381-bf, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6c4e67fd-fb81-4311-b336-25a59115fc88) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:16:21 user nova-compute[75621]: INFO os_vif [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:f1:17,bridge_name='br-int',has_traffic_filtering=True,id=93c55381-bfcc-436d-aa32-9a0f4ee3e6f2,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93c55381-bf')
Nov 27 23:16:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Deleting instance files /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129_del
Nov 27 23:16:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Deletion of /opt/stack/data/nova/instances/144ce759-4144-4606-8a2d-90034d7f9129_del complete
Nov 27 23:16:21 user nova-compute[75621]: INFO nova.compute.manager [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 23:16:21 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:16:21 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing instance network info cache due to event network-changed-4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] Acquiring lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] Acquired lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Refreshing network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:22 user nova-compute[75621]: INFO nova.compute.manager [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Detaching volume 7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updated VIF entry in instance network info cache for port 4cb34199-31b4-4cce-b269-7a71b5cd6d77. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [{"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:22 user nova-compute[75621]: INFO nova.virt.block_device [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Attempting to driver detach volume 7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 from mountpoint /dev/vdb
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Attempting to detach device vdb from instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:16:22 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:16:22 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:16:22 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:16:22 user nova-compute[75621]:   <serial>7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523</serial>
Nov 27 23:16:22 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:16:22 user nova-compute[75621]: </disk>
Nov 27 23:16:22 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cdb795b5-9fd3-4f8f-9d72-f882a5e820a8 req-7d9a69e5-8706-41d8-8c8b-6a7bf7f90a99 service nova] Releasing lock "refresh_cache-1a460ee6-8f9c-4973-9046-9ab3c8f6a022" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully detached device vdb from instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 from the persistent domain config.
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:16:22 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:16:22 user nova-compute[75621]:   <source dev="/dev/sde"/>
Nov 27 23:16:22 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:16:22 user nova-compute[75621]:   <serial>7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523</serial>
Nov 27 23:16:22 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:16:22 user nova-compute[75621]: </disk>
Nov 27 23:16:22 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:22 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Took 1.28 seconds to deallocate network for instance.
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-4b28d0d1-5a46-477a-adeb-f7a8d64175cb req-68aa8ea7-484d-4067-9ae5-93db7ebf1baa service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-deleted-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] Acquiring lock "144ce759-4144-4606-8a2d-90034d7f9129-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] Lock "144ce759-4144-4606-8a2d-90034d7f9129-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] No waiting events found dispatching network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:22 user nova-compute[75621]: WARNING nova.compute.manager [req-d7456af0-dcce-4e93-a7db-fc97fc14563a req-88d5a513-e26d-44d1-9ab3-8b0900735a56 service nova] [instance: 144ce759-4144-4606-8a2d-90034d7f9129] Received unexpected event network-vif-plugged-93c55381-bfcc-436d-aa32-9a0f4ee3e6f2 for instance with vm_state deleted and task_state None.
Nov 27 23:16:23 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:16:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:16:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:16:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:23 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Deleted allocations for instance 144ce759-4144-4606-8a2d-90034d7f9129
Nov 27 23:16:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8bbd9783-2c57-4be7-b1bf-76851cf35244 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "144ce759-4144-4606-8a2d-90034d7f9129" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.882s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:43 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 is timed out.
Nov 27 23:16:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully detached device vdb from instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 from the live domain config.
Nov 27 23:16:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNQtAUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:16:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f74193f-cfb3-4978-8caa-3b621202d379]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:16:43 user nova-compute[75621]: No targets found.
Nov 27 23:16:43 user nova-compute[75621]: iSNS:
Nov 27 23:16:43 user nova-compute[75621]: No targets found.
Nov 27 23:16:43 user nova-compute[75621]: STATIC:
Nov 27 23:16:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:16:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:16:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:16:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523
Nov 27 23:16:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:16:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:16:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:16:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:16:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:16:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:16:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:16:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:16:43 user nova-compute[75621]: FIRMWARE:
Nov 27 23:16:43 user nova-compute[75621]: No targets found.
Nov 27 23:16:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:16:43 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:16:43 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db65064-8a1f-4d3c-a49b-fe6b5967a54d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe8fcac-feda-4c6d-9a89-f39b77146260]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:16:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 (non-flash)
Nov 27 23:16:43 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:16:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07c0dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[393f957d-6833-4dce-a038-4de8ddd20f09]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f51932f-38ac-41e8-88dd-7a543175842b]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1a5aad-0eb3-4140-b0a7-8484808da362]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcde59d-96ad-43ca-ba4c-325001d639da]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4451afd0-ac76-4f06-a14b-1eeac075c134]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18f67ed-b6b5-4b89-a9d2-8117d96bdf8f]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260]
Nov 27 23:16:43 user nova-compute[75621]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523, portal: 172.16.0.220,3260] successful.
Nov 27 23:16:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7255efc8-c7f6-4d0a-a0e2-3ef76bbcc523 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827d48b-d005-4e66-b324-15dddef7b9a4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] <== disconnect_volume: return (332ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:16:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:16:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'flavor' on Instance uuid 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-4a3b8f32-1c3d-46c6-957c-da182370fce0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.672s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:16:47 user nova-compute[75621]: INFO nova.compute.claims [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Claim successful on node user
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:16:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.policy [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ef6cc601c4e455595057cb4d0dc33b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c922ea90054fc0b2220e2431ea900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:16:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Creating image(s)
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.222s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk 1073741824" returned: 0 in 0.052s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Successfully created port: 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Cannot resize image /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Ensure instance console log exists: /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Successfully updated port: 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing instance network info cache due to event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance network_info: |[{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.neutron [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start _get_guest_xml network_info=[{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:16:49 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:16:49 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1787616905',display_name='tempest-ServerRescueNegativeTestJSON-server-1787616905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1787616905',id=33,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS0ZwCHXZAnAR6OYHa6naOHeK2boGFA0IKffVC80SngxVY1SyQMcK2omJDuPeINGk2K/mtCUlyxFnPRUx6wJ8EC9epWvHYo0YwlCOb83aw4u90rQ7Q4PnW+SBU0DAipng==',key_name='tempest-keypair-950122851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-6guz2f5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=ec98e368-8ca4-45ce-8e68-4e49bc3a6f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:16:49 user nova-compute[75621]:   <uuid>ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</uuid>
Nov 27 23:16:49 user nova-compute[75621]:   <name>instance-00000021</name>
Nov 27 23:16:49 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:16:49 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:16:49 user nova-compute[75621]:   <metadata>
Nov 27 23:16:49 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:16:49 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1787616905</nova:name>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:16:49</nova:creationTime>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:16:49 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:16:49 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:owner>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:16:49 user nova-compute[75621]:       </nova:owner>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:16:49 user nova-compute[75621]:       <nova:ports>
Nov 27 23:16:49 user nova-compute[75621]:         <nova:port uuid="981040bc-bd4a-4b8c-9444-d104e09cc3ed">
Nov 27 23:16:49 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:16:49 user nova-compute[75621]:         </nova:port>
Nov 27 23:16:49 user nova-compute[75621]:       </nova:ports>
Nov 27 23:16:49 user nova-compute[75621]:     </nova:instance>
Nov 27 23:16:49 user nova-compute[75621]:   </metadata>
Nov 27 23:16:49 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:16:49 user nova-compute[75621]:     <system>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="serial">ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</entry>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="uuid">ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</entry>
Nov 27 23:16:49 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:16:49 user nova-compute[75621]:     </system>
Nov 27 23:16:49 user nova-compute[75621]:   </sysinfo>
Nov 27 23:16:49 user nova-compute[75621]:   <os>
Nov 27 23:16:49 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:16:49 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:16:49 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:16:49 user nova-compute[75621]:   </os>
Nov 27 23:16:49 user nova-compute[75621]:   <features>
Nov 27 23:16:49 user nova-compute[75621]:     <acpi/>
Nov 27 23:16:49 user nova-compute[75621]:     <apic/>
Nov 27 23:16:49 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:16:49 user nova-compute[75621]:   </features>
Nov 27 23:16:49 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:16:49 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:16:49 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:16:49 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:16:49 user nova-compute[75621]:   </clock>
Nov 27 23:16:49 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:16:49 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:16:49 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:16:49 user nova-compute[75621]:   </cpu>
Nov 27 23:16:49 user nova-compute[75621]:   <devices>
Nov 27 23:16:49 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:16:49 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:16:49 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk"/>
Nov 27 23:16:49 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:16:49 user nova-compute[75621]:     </disk>
Nov 27 23:16:49 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:16:49 user nova-compute[75621]:       <mac address="fa:16:3e:12:23:98"/>
Nov 27 23:16:49 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:16:49 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:16:49 user nova-compute[75621]:       <target dev="tap981040bc-bd"/>
Nov 27 23:16:49 user nova-compute[75621]:     </interface>
Nov 27 23:16:49 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:16:49 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/console.log" append="off"/>
Nov 27 23:16:49 user nova-compute[75621]:     </serial>
Nov 27 23:16:49 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:16:49 user nova-compute[75621]:     <video>
Nov 27 23:16:49 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:16:49 user nova-compute[75621]:     </video>
Nov 27 23:16:49 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:16:49 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:16:49 user nova-compute[75621]:     </rng>
Nov 27 23:16:49 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:16:49 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:16:49 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:16:49 user nova-compute[75621]:     </memballoon>
Nov 27 23:16:49 user nova-compute[75621]:   </devices>
Nov 27 23:16:49 user nova-compute[75621]: </domain>
Nov 27 23:16:49 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1787616905',display_name='tempest-ServerRescueNegativeTestJSON-server-1787616905',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1787616905',id=33,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS0ZwCHXZAnAR6OYHa6naOHeK2boGFA0IKffVC80SngxVY1SyQMcK2omJDuPeINGk2K/mtCUlyxFnPRUx6wJ8EC9epWvHYo0YwlCOb83aw4u90rQ7Q4PnW+SBU0DAipng==',key_name='tempest-keypair-950122851',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-6guz2f5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:16:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=ec98e368-8ca4-45ce-8e68-4e49bc3a6f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG os_vif [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '552a0d91-e9b0-58d1-b3ee-55c4af381a04', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap981040bc-bd, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap981040bc-bd, col_values=(('qos', UUID('853348f6-1d42-4113-838b-bd94297a1f45')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap981040bc-bd, col_values=(('external_ids', {'iface-id': '981040bc-bd4a-4b8c-9444-d104e09cc3ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:23:98', 'vm-uuid': 'ec98e368-8ca4-45ce-8e68-4e49bc3a6f69'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:49 user nova-compute[75621]: INFO os_vif [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd')
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:12:23:98, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:16:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updated VIF entry in instance network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:16:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d9318256-fd6d-4c18-804f-50e42a1a9cbc req-724ae6b2-1e21-4601-b597-aa94af026030 service nova] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:51 user nova-compute[75621]: WARNING nova.compute.manager [req-bd020e99-6f7a-417e-a4f9-502e586af205 req-da047362-f60b-490b-8309-a2362a44a4c0 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state building and task_state spawning.
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:16:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance spawned successfully.
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:16:53 user nova-compute[75621]: INFO nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:16:53 user nova-compute[75621]: WARNING nova.compute.manager [req-64fe52da-bba1-4e9b-9c4a-5874fd43e15c req-7ae06089-c7b1-45a6-bfa4-036b519c64a3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state building and task_state spawning.
Nov 27 23:16:53 user nova-compute[75621]: INFO nova.compute.manager [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Took 6.46 seconds to build instance.
Nov 27 23:16:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c9c5d420-6de0-4856-b16e-51dd3d3197a6 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.575s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing instance network info cache due to event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:16:54 user nova-compute[75621]: DEBUG nova.network.neutron [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:16:55 user nova-compute[75621]: DEBUG nova.network.neutron [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updated VIF entry in instance network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:16:55 user nova-compute[75621]: DEBUG nova.network.neutron [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:16:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6c8ecf7-6b18-4798-8fab-a2ad550b95f2 req-a8a62937-decf-4a60-af83-b478b4f7b211 service nova] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:16:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:16:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:16:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:16:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:00 user nova-compute[75621]: INFO nova.compute.manager [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Shelving
Nov 27 23:17:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:01 user nova-compute[75621]: WARNING nova.compute.manager [req-e49523fc-5b28-4263-8c6c-350ef659b8d2 req-bf857a22-f709-4671-a65d-b69adcc4d4b6 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state active and task_state shelving.
Nov 27 23:17:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance destroyed successfully.
Nov 27 23:17:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Beginning cold snapshot process
Nov 27 23:17:02 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:17:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk /opt/stack/data/nova/instances/snapshots/tmppn0i85zj/21df3dae056b4d30897f16640fd10b9a {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk /opt/stack/data/nova/instances/snapshots/tmppn0i85zj/21df3dae056b4d30897f16640fd10b9a" returned: 0 in 0.747s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Snapshot extracted, beginning image upload
Nov 27 23:17:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:03 user nova-compute[75621]: WARNING nova.compute.manager [req-4e8ef1da-ecce-4b28-bc44-d4d521f8d90f req-4f1e5063-2da7-49eb-a2c4-4c8e7d559c11 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Snapshot image upload complete
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:17:06 user nova-compute[75621]: INFO nova.compute.manager [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Shelve offloading
Nov 27 23:17:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance destroyed successfully.
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:17:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:07 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7742MB free_disk=24.778240203857422GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:17:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance destroyed successfully.
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'resources' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFET04Pr4JasiQs0bEYmtK0++Dj80KCh7ZsPwryHdlNYA/AKOTcE3TOJqbKBil0AZN45judq2NOFk02C1/wxdXKHPYWpAkgZYOJZBR5JFEbI7EGa1enDsOzISAIQdAfmA==',key_name='tempest-keypair-905213494',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:17:06.056527',shelved_host='user',shelved_image_id='07212a3f-4085-4e53-a26c-3db4bcf04ad2'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG os_vif [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing instance network info cache due to event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6651aae-e6, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcaa4574-9af5-4ff3-b38a-83ddca5f7ace) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:07 user nova-compute[75621]: INFO os_vif [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6')
Nov 27 23:17:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Deleting instance files /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c_del
Nov 27 23:17:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Deletion of /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c_del complete
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:17:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:17:07 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Deleted allocations for instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.864s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.242s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.objects.base [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<7b4dc389-1c65-4b86-827a-fc8d6bab644c> lazy-loaded attributes: resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.network.neutron [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updated VIF entry in instance network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG nova.network.neutron [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa6651aae-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-feac198d-ad37-4d52-b4b6-6d4c7ceb8e12 req-12f76e16-72c9-4a7f-86fa-a73c8eede412 service nova] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d4df3-df56-4177-b6f7-1ca3e3bbf8e1 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.915s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:17:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:17:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:17:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:17:14 user nova-compute[75621]: INFO nova.compute.claims [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Claim successful on node user
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:17:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.policy [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c7f3a4fe69a492aab4db9062a6d838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565ce700aeda4eb49c85cd697a9c0736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:17:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Creating image(s)
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk 1073741824" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Successfully created port: 778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Cannot resize image /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Ensure instance console log exists: /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Successfully updated port: 778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquired lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-changed-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Refreshing instance network info cache due to event network-changed-778cc220-40b0-4ac3-8901-5219cdc328f6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] Acquiring lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:17 user nova-compute[75621]: INFO nova.compute.manager [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Terminating instance
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updating instance_info_cache with network_info: [{"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Releasing lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Instance network_info: |[{"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] Acquired lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Refreshing network info cache for port 778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Start _get_guest_xml network_info=[{"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:17:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1190946677',display_name='tempest-AttachVolumeNegativeTest-server-1190946677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1190946677',id=34,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGneCw1Git/2AmqG9mWiHn/ZSpzcN+eVREW7+3oYDfargWhk8ScV+0uERkXGbRCxgMx+3LZ0mMTrmje0sVtvxHUSs7PqJFiV0CT2rAxDfmChsUMiPJ2roxhNCfNoRbahzg==',key_name='tempest-keypair-60551326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-iql5ip94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=ce4bf2e9-c666-4c68-88d4-f746ee5280d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.objects.instance [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'pci_devices' on Instance uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:17:17 user nova-compute[75621]:   <uuid>ce4bf2e9-c666-4c68-88d4-f746ee5280d6</uuid>
Nov 27 23:17:17 user nova-compute[75621]:   <name>instance-00000022</name>
Nov 27 23:17:17 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:17:17 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:17:17 user nova-compute[75621]:   <metadata>
Nov 27 23:17:17 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:17:17 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1190946677</nova:name>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:17:17</nova:creationTime>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:17:17 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:17:17 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:owner>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:user uuid="6c7f3a4fe69a492aab4db9062a6d838b">tempest-AttachVolumeNegativeTest-862898080-project-member</nova:user>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:project uuid="565ce700aeda4eb49c85cd697a9c0736">tempest-AttachVolumeNegativeTest-862898080</nova:project>
Nov 27 23:17:17 user nova-compute[75621]:       </nova:owner>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:17:17 user nova-compute[75621]:       <nova:ports>
Nov 27 23:17:17 user nova-compute[75621]:         <nova:port uuid="778cc220-40b0-4ac3-8901-5219cdc328f6">
Nov 27 23:17:17 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:17:17 user nova-compute[75621]:         </nova:port>
Nov 27 23:17:17 user nova-compute[75621]:       </nova:ports>
Nov 27 23:17:17 user nova-compute[75621]:     </nova:instance>
Nov 27 23:17:17 user nova-compute[75621]:   </metadata>
Nov 27 23:17:17 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:17:17 user nova-compute[75621]:     <system>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="serial">ce4bf2e9-c666-4c68-88d4-f746ee5280d6</entry>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="uuid">ce4bf2e9-c666-4c68-88d4-f746ee5280d6</entry>
Nov 27 23:17:17 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:17:17 user nova-compute[75621]:     </system>
Nov 27 23:17:17 user nova-compute[75621]:   </sysinfo>
Nov 27 23:17:17 user nova-compute[75621]:   <os>
Nov 27 23:17:17 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:17:17 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:17:17 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:17:17 user nova-compute[75621]:   </os>
Nov 27 23:17:17 user nova-compute[75621]:   <features>
Nov 27 23:17:17 user nova-compute[75621]:     <acpi/>
Nov 27 23:17:17 user nova-compute[75621]:     <apic/>
Nov 27 23:17:17 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:17:17 user nova-compute[75621]:   </features>
Nov 27 23:17:17 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:17:17 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:17:17 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:17:17 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:17:17 user nova-compute[75621]:   </clock>
Nov 27 23:17:17 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:17:17 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:17:17 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:17:17 user nova-compute[75621]:   </cpu>
Nov 27 23:17:17 user nova-compute[75621]:   <devices>
Nov 27 23:17:17 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:17:17 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:17:17 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk"/>
Nov 27 23:17:17 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:17:17 user nova-compute[75621]:     </disk>
Nov 27 23:17:17 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:17:17 user nova-compute[75621]:       <mac address="fa:16:3e:a6:56:25"/>
Nov 27 23:17:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:17:17 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:17:17 user nova-compute[75621]:       <target dev="tap778cc220-40"/>
Nov 27 23:17:17 user nova-compute[75621]:     </interface>
Nov 27 23:17:17 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:17:17 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/console.log" append="off"/>
Nov 27 23:17:17 user nova-compute[75621]:     </serial>
Nov 27 23:17:17 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:17:17 user nova-compute[75621]:     <video>
Nov 27 23:17:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:17:17 user nova-compute[75621]:     </video>
Nov 27 23:17:17 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:17:17 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:17:17 user nova-compute[75621]:     </rng>
Nov 27 23:17:17 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:17:17 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:17:17 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:17:17 user nova-compute[75621]:     </memballoon>
Nov 27 23:17:17 user nova-compute[75621]:   </devices>
Nov 27 23:17:17 user nova-compute[75621]: </domain>
Nov 27 23:17:17 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1190946677',display_name='tempest-AttachVolumeNegativeTest-server-1190946677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1190946677',id=34,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGneCw1Git/2AmqG9mWiHn/ZSpzcN+eVREW7+3oYDfargWhk8ScV+0uERkXGbRCxgMx+3LZ0mMTrmje0sVtvxHUSs7PqJFiV0CT2rAxDfmChsUMiPJ2roxhNCfNoRbahzg==',key_name='tempest-keypair-60551326',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-iql5ip94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:17:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=ce4bf2e9-c666-4c68-88d4-f746ee5280d6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG os_vif [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0acdb7b-f8e8-5356-96cc-e57b305239f9', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap778cc220-40, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap778cc220-40, col_values=(('qos', UUID('a46dc4fd-6e49-44bb-903c-129276046ed6')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap778cc220-40, col_values=(('external_ids', {'iface-id': '778cc220-40b0-4ac3-8901-5219cdc328f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:56:25', 'vm-uuid': 'ce4bf2e9-c666-4c68-88d4-f746ee5280d6'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:17 user nova-compute[75621]: INFO os_vif [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40')
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:a6:56:25, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-d726f9d3-bb6e-41cd-8c86-814cba8553ed req-d66bc6c0-db0a-4eec-b9e5-6c85266e3dc3 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-unplugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:17:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Instance destroyed successfully.
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lazy-loading 'resources' on Instance uuid 1a460ee6-8f9c-4973-9046-9ab3c8f6a022 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230269902',display_name='tempest-TestMinimumBasicScenario-server-230269902',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230269902',id=28,image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2RmJzrmEMDAgye2SskpTG/55ZQ6p3CsXMQZU2Pv2H4Ln6Bb9f/fJg/eN2/WrY0bqncoPqf5Lnk0HdtmyqTRIXx7EMCVvzr8UoVwUIvzfdTzwn6GGXGFI4yQz+WxC87Zw==',key_name='tempest-TestMinimumBasicScenario-394531675',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:12:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b3b221a362d4bd6b7a057c97513a70b',ramdisk_id='',reservation_id='r-n1q0h8as',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='1595f84a-81a9-4819-84a8-a5ec94e1b17b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1822102155',owner_user_name='tempest-TestMinimumBasicScenario-1822102155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:14:38Z,user_data=None,user_id='22a7b251f7b641e184d1fc8bb44562b9',uuid=1a460ee6-8f9c-4973-9046-9ab3c8f6a022,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converting VIF {"id": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "address": "fa:16:3e:33:a5:70", "network": {"id": "9913e5f5-73ec-4d98-bdef-1af46915616c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2046437194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9b3b221a362d4bd6b7a057c97513a70b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cb34199-31", "ovs_interfaceid": "4cb34199-31b4-4cce-b269-7a71b5cd6d77", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG os_vif [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cb34199-31, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7159cd19-1f4a-46f6-80ba-82ed5ed7ea3d) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:18 user nova-compute[75621]: INFO os_vif [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:a5:70,bridge_name='br-int',has_traffic_filtering=True,id=4cb34199-31b4-4cce-b269-7a71b5cd6d77,network=Network(9913e5f5-73ec-4d98-bdef-1af46915616c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cb34199-31')
Nov 27 23:17:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Deleting instance files /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022_del
Nov 27 23:17:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Deletion of /opt/stack/data/nova/instances/1a460ee6-8f9c-4973-9046-9ab3c8f6a022_del complete
Nov 27 23:17:18 user nova-compute[75621]: INFO nova.compute.manager [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 23:17:18 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updated VIF entry in instance network info cache for port 778cc220-40b0-4ac3-8901-5219cdc328f6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updating instance_info_cache with network_info: [{"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-98ef7897-c1e0-48e7-b418-395a385422de req-3dfcb54d-0d35-4454-a566-8f93918f57ef service nova] Releasing lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:18 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Took 0.44 seconds to deallocate network for instance.
Nov 27 23:17:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:17:18 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:19 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Deleted allocations for instance 1a460ee6-8f9c-4973-9046-9ab3c8f6a022
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-6d54bbed-d5c3-4cab-b9f3-bc05158525a0 tempest-TestMinimumBasicScenario-1822102155 tempest-TestMinimumBasicScenario-1822102155-project-member] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.951s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:19 user nova-compute[75621]: WARNING nova.compute.manager [req-8f20ab20-1524-4f9a-85be-f661f5288769 req-6cc26862-6d71-42ee-8e2b-e7bb5ebe03ae service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state building and task_state spawning.
Nov 27 23:17:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] Acquiring lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] Lock "1a460ee6-8f9c-4973-9046-9ab3c8f6a022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] No waiting events found dispatching network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:19 user nova-compute[75621]: WARNING nova.compute.manager [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received unexpected event network-vif-plugged-4cb34199-31b4-4cce-b269-7a71b5cd6d77 for instance with vm_state deleted and task_state None.
Nov 27 23:17:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-71335378-80a2-4487-a45e-03b20bbb9121 req-914d590e-7b19-4961-bafc-d4913f51a2b0 service nova] [instance: 1a460ee6-8f9c-4973-9046-9ab3c8f6a022] Received event network-vif-deleted-4cb34199-31b4-4cce-b269-7a71b5cd6d77 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:17:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Instance spawned successfully.
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:21 user nova-compute[75621]: WARNING nova.compute.manager [req-095af05f-e39d-4055-b6a6-698d2b25ef5f req-ae27285d-c851-499e-ae3d-027f7ef2acff service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state building and task_state spawning.
Nov 27 23:17:21 user nova-compute[75621]: INFO nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Took 6.28 seconds to spawn the instance on the hypervisor.
Nov 27 23:17:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:17:21 user nova-compute[75621]: INFO nova.compute.manager [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Took 7.14 seconds to build instance.
Nov 27 23:17:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-331ceff3-1c54-4e33-9a3c-6c0bd0ce6235 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.257s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid f13a1f06-0c06-46df-b958-bfc33d6272fa {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 6573b4cf-062d-4beb-b387-1f0966fd1ae8 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 0f0eef2e-b116-4f58-a23a-af764f533bf9 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 203ff896-ed38-4378-9146-075fb92cf657 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b75ec495-38b4-42ff-a489-13b76129b094" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "203ff896-ed38-4378-9146-075fb92cf657" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b75ec495-38b4-42ff-a489-13b76129b094" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.077s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "203ff896-ed38-4378-9146-075fb92cf657" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:17:42 user nova-compute[75621]: INFO nova.compute.claims [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Claim successful on node user
Nov 27 23:17:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:17:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.policy [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f94d81e556a74a408cb5d1dd9ad11309', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ff17a3fc094e00a80fd77a3f056b00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:17:43 user nova-compute[75621]: INFO nova.virt.block_device [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Booting with volume 8e88462c-611a-46f4-8273-b8c7cee5dc56 at /dev/vda
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7115fd9b-be9e-4fa4-a32b-4a096acfccf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225ac87-c5ae-4d65-93f4-2166bca9b351]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d0e2db-31d8-4030-a8c2-d9f554e4c8e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4013b74a-b650-425b-837d-13c29c4f4b73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:17:43 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:17:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb2509-b966-460d-9a8e-f307b373f8d6]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:17:43 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating existing volume attachment record: ba837f88-a62d-465a-b74c-69c6a767bf90 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Successfully created port: 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Successfully updated port: 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing instance network info cache due to event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance network_info: |[{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated VIF entry in instance network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:17:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2a36c161-6bf7-4f7e-bcd8-f5ee5b23264c req-c76daad4-67d1-427f-9897-8e60a04666c0 service nova] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:17:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:17:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Creating image(s)
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Ensure instance console log exists: /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start _get_guest_xml network_info=[{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'ba837f88-a62d-465a-b74c-69c6a767bf90', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd10e0d60-288a-41e7-865f-01fe514ab7d8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e88462c-611a-46f4-8273-b8c7cee5dc56', 'serial': '8e88462c-611a-46f4-8273-b8c7cee5dc56'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:17:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:17:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:17:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:17:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:17:51 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9892ad86-36af-4ffb-851e-2a84d0c0322e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:17:51 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4f5eb2-5912-4561-93ae-d95c3d9d8241]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56] added
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f77034c-93df-4619-b89a-fe884cc19fe1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30f431-5416-48fa-9ce1-34c9d51bd8be]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIvJYxjp {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIvJYxjp" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[adca0a94-af66-4e1f-9e2b-f62802550686]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIvJYxjp'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b6dbb7-3298-4267-a695-7e7e8ba29b4a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe844ca4-1e79-45d4-871c-bb849ea09d95]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af06d6-26e6-4610-b560-72bc96d39329]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]
Nov 27 23:17:51 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb30a550-ddaa-4973-b0fd-4e84609471f7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf83a8c-d2e4-481d-a7b4-8d4d145e73ac]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:17:51 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:17:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5600e-a8db-4117-a848-f63fc693a4ad]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:17:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26234643939386431', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234643939386431', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXTS2BjNbZ3FT+r/pITUL+bItthGa8a0JmXE47UIE8ULsb1xEhgqmNpq+j+DaQaCLAelEiOnnqJB2Bgu6wk+e5tW8MxxbbyzaEb6/fjTvqTMoNhayjZDF7xi8ufTvwgHw==',key_name='tempest-TestShelveInstance-1372082336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:17:44Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'pci_devices' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:17:52 user nova-compute[75621]:   <uuid>d10e0d60-288a-41e7-865f-01fe514ab7d8</uuid>
Nov 27 23:17:52 user nova-compute[75621]:   <name>instance-00000023</name>
Nov 27 23:17:52 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:17:52 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:17:52 user nova-compute[75621]:   <metadata>
Nov 27 23:17:52 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:17:52 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:17:52 user nova-compute[75621]:       <nova:name>tempest-TestShelveInstance-server-576060454</nova:name>
Nov 27 23:17:52 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:17:50</nova:creationTime>
Nov 27 23:17:52 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:17:52 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:17:52 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:17:52 user nova-compute[75621]:       <nova:owner>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:user uuid="f94d81e556a74a408cb5d1dd9ad11309">tempest-TestShelveInstance-864618270-project-member</nova:user>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:project uuid="67ff17a3fc094e00a80fd77a3f056b00">tempest-TestShelveInstance-864618270</nova:project>
Nov 27 23:17:52 user nova-compute[75621]:       </nova:owner>
Nov 27 23:17:52 user nova-compute[75621]:       <nova:ports>
Nov 27 23:17:52 user nova-compute[75621]:         <nova:port uuid="8a35be82-e44d-4e93-8d55-21c809b1daf7">
Nov 27 23:17:52 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:17:52 user nova-compute[75621]:         </nova:port>
Nov 27 23:17:52 user nova-compute[75621]:       </nova:ports>
Nov 27 23:17:52 user nova-compute[75621]:     </nova:instance>
Nov 27 23:17:52 user nova-compute[75621]:   </metadata>
Nov 27 23:17:52 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:17:52 user nova-compute[75621]:     <system>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="serial">d10e0d60-288a-41e7-865f-01fe514ab7d8</entry>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="uuid">d10e0d60-288a-41e7-865f-01fe514ab7d8</entry>
Nov 27 23:17:52 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:17:52 user nova-compute[75621]:     </system>
Nov 27 23:17:52 user nova-compute[75621]:   </sysinfo>
Nov 27 23:17:52 user nova-compute[75621]:   <os>
Nov 27 23:17:52 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:17:52 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:17:52 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:17:52 user nova-compute[75621]:   </os>
Nov 27 23:17:52 user nova-compute[75621]:   <features>
Nov 27 23:17:52 user nova-compute[75621]:     <acpi/>
Nov 27 23:17:52 user nova-compute[75621]:     <apic/>
Nov 27 23:17:52 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:17:52 user nova-compute[75621]:   </features>
Nov 27 23:17:52 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:17:52 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:17:52 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:17:52 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:17:52 user nova-compute[75621]:   </clock>
Nov 27 23:17:52 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:17:52 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:17:52 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:17:52 user nova-compute[75621]:   </cpu>
Nov 27 23:17:52 user nova-compute[75621]:   <devices>
Nov 27 23:17:52 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:17:52 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:17:52 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:17:52 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:17:52 user nova-compute[75621]:       <serial>8e88462c-611a-46f4-8273-b8c7cee5dc56</serial>
Nov 27 23:17:52 user nova-compute[75621]:     </disk>
Nov 27 23:17:52 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:17:52 user nova-compute[75621]:       <mac address="fa:16:3e:51:a2:7b"/>
Nov 27 23:17:52 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:17:52 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:17:52 user nova-compute[75621]:       <target dev="tap8a35be82-e4"/>
Nov 27 23:17:52 user nova-compute[75621]:     </interface>
Nov 27 23:17:52 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:17:52 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8/console.log" append="off"/>
Nov 27 23:17:52 user nova-compute[75621]:     </serial>
Nov 27 23:17:52 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:17:52 user nova-compute[75621]:     <video>
Nov 27 23:17:52 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:17:52 user nova-compute[75621]:     </video>
Nov 27 23:17:52 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:17:52 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:17:52 user nova-compute[75621]:     </rng>
Nov 27 23:17:52 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:17:52 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:17:52 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:17:52 user nova-compute[75621]:     </memballoon>
Nov 27 23:17:52 user nova-compute[75621]:   </devices>
Nov 27 23:17:52 user nova-compute[75621]: </domain>
Nov 27 23:17:52 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXTS2BjNbZ3FT+r/pITUL+bItthGa8a0JmXE47UIE8ULsb1xEhgqmNpq+j+DaQaCLAelEiOnnqJB2Bgu6wk+e5tW8MxxbbyzaEb6/fjTvqTMoNhayjZDF7xi8ufTvwgHw==',key_name='tempest-TestShelveInstance-1372082336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:17:44Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG os_vif [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '915456ad-e983-50c9-9b50-a5fe180f9ffe', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a35be82-e4, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a35be82-e4, col_values=(('qos', UUID('b22d4c57-e077-433c-ab9c-571f03900591')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a35be82-e4, col_values=(('external_ids', {'iface-id': '8a35be82-e44d-4e93-8d55-21c809b1daf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a2:7b', 'vm-uuid': 'd10e0d60-288a-41e7-865f-01fe514ab7d8'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:52 user nova-compute[75621]: INFO os_vif [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4')
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:17:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] No VIF found with MAC fa:16:3e:51:a2:7b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:17:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:54 user nova-compute[75621]: WARNING nova.compute.manager [req-ccab5c25-1929-40b9-b63f-0226642bef2b req-a6fd58dd-ec6d-4578-a9fa-197d2ebfc90b service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state building and task_state spawning.
Nov 27 23:17:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:17:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance spawned successfully.
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:17:55 user nova-compute[75621]: INFO nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 27 23:17:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:17:56 user nova-compute[75621]: WARNING nova.compute.manager [req-47f37907-d488-49d3-83f6-f97e7509351b req-9f223ebb-1083-4fbe-a2a3-acfc108109ed service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state building and task_state spawning.
Nov 27 23:17:56 user nova-compute[75621]: INFO nova.compute.manager [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Took 13.16 seconds to build instance.
Nov 27 23:17:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-35ee2e0a-1abd-4dc2-88d9-4c26879978e2 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.309s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:17:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:17:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:17:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:17:59 user nova-compute[75621]: INFO nova.compute.manager [None req-a7942a03-f575-4fc4-a3c6-17408fa89535 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Get console output
Nov 27 23:17:59 user nova-compute[75621]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 27 23:17:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:18:01 user nova-compute[75621]: INFO nova.compute.claims [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Claim successful on node user
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:01 user nova-compute[75621]: INFO nova.compute.manager [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Terminating instance
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:18:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:18:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:01 user nova-compute[75621]: INFO nova.virt.block_device [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Booting with volume snapshot 2aeefb0b-f338-4561-a92a-d4ff97597c19 at /dev/vda
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.policy [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-d4459651-4e96-4b4e-8f0f-fcb2be2272c3 req-d5febc7a-f1c5-4b5e-a641-bb397e4ae13d service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-unplugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Instance destroyed successfully.
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid 89a23062-cf16-4dd9-b6e8-7483115ca1c3 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1098098055',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1098098055',id=30,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:14:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-002dwlh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:16:15Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=89a23062-cf16-4dd9-b6e8-7483115ca1c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "address": "fa:16:3e:21:07:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bc17f22-a1", "ovs_interfaceid": "6bc17f22-a156-4844-8a19-a37664ce1d9e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_vif [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bc17f22-a1, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=52a91487-3530-4214-b9f2-6ea617179613) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:02 user nova-compute[75621]: INFO os_vif [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:07:4d,bridge_name='br-int',has_traffic_filtering=True,id=6bc17f22-a156-4844-8a19-a37664ce1d9e,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bc17f22-a1')
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nLUWJqsi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:18:02 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436a63a-13a2-44b4-a309-deaa61103dbb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:18:02 user nova-compute[75621]: No targets found.
Nov 27 23:18:02 user nova-compute[75621]: iSNS:
Nov 27 23:18:02 user nova-compute[75621]: No targets found.
Nov 27 23:18:02 user nova-compute[75621]: STATIC:
Nov 27 23:18:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:18:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:18:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:18:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:18:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:18:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:18:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:18:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:18:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:18:02 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980
Nov 27 23:18:02 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:18:02 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:18:02 user nova-compute[75621]: FIRMWARE:
Nov 27 23:18:02 user nova-compute[75621]: No targets found.
Nov 27 23:18:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:18:02 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:18:02 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8161e072-cd08-48c2-9620-160ff1b66c6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48575445-cc7c-41e9-bbf6-2854f5178ddf]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:02 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0575870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ddd8f8-8fcb-4b95-b427-f861ec90ebbe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa68ca5-b4e4-40e5-831b-538e313a3b8b]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f33ab3-3c8a-4ca2-9e07-b3971cf8f93f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28767671-67d1-449c-8a61-1375b2453158]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_149bea8b', '/dev/disk/by-id/scsi-26534336561303636', '/dev/disk/by-id/scsi-1SCST_BIO149bea8b-e43ea066701f93cf') {{(pid=86804) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb20fea-c5d7-4a4e-b250-17dd1c2808c4]: (4, None) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b546ab1a-f0e1-4e6f-b268-ca6aca8a1b68]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9894637-9eda-4542-9da1-ea91c18ab680]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260]
Nov 27 23:18:02 user nova-compute[75621]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980, portal: 172.16.0.220,3260] successful.
Nov 27 23:18:02 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:71cf7f9a-e2e6-455b-8065-0ecde4d24980 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[297fa978-e052-4f7f-8d15-4035cd5655e1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== disconnect_volume: return (353ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:18:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Deleting instance files /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3_del
Nov 27 23:18:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Deletion of /opt/stack/data/nova/instances/89a23062-cf16-4dd9-b6e8-7483115ca1c3_del complete
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Successfully created port: e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:18:02 user nova-compute[75621]: INFO nova.compute.manager [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Took 1.32 seconds to destroy the instance on the hypervisor.
Nov 27 23:18:02 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:18:02 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:03 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Took 0.48 seconds to deallocate network for instance.
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-88a5b726-7e61-431c-a73a-fa4dcbcbfa35 req-66801154-c0e8-4755-a5d4-123e047c1c14 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-deleted-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:03 user nova-compute[75621]: INFO nova.compute.manager [req-88a5b726-7e61-431c-a73a-fa4dcbcbfa35 req-66801154-c0e8-4755-a5d4-123e047c1c14 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Neutron deleted interface 6bc17f22-a156-4844-8a19-a37664ce1d9e; detaching it from the instance and deleting it from the info cache
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-88a5b726-7e61-431c-a73a-fa4dcbcbfa35 req-66801154-c0e8-4755-a5d4-123e047c1c14 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-88a5b726-7e61-431c-a73a-fa4dcbcbfa35 req-66801154-c0e8-4755-a5d4-123e047c1c14 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Detach interface failed, port_id=6bc17f22-a156-4844-8a19-a37664ce1d9e, reason: Instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Successfully updated port: e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-changed-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Refreshing instance network info cache due to event network-changed-e13d1729-5624-4c48-8d60-2c5ff4a60c65. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] Acquiring lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Updating instance_info_cache with network_info: [{"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Instance network_info: |[{"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] Acquired lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Refreshing network info cache for port e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] Acquiring lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] No waiting events found dispatching network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:03 user nova-compute[75621]: WARNING nova.compute.manager [req-b6e1931e-83c1-451f-ba67-61d7036d3dac req-595eee81-cb5b-4d7b-91be-c9b4fc023321 service nova] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Received unexpected event network-vif-plugged-6bc17f22-a156-4844-8a19-a37664ce1d9e for instance with vm_state active and task_state deleting.
Nov 27 23:18:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:04 user nova-compute[75621]: INFO nova.compute.manager [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 89a23062-cf16-4dd9-b6e8-7483115ca1c3] Took 0.77 seconds to detach 1 volumes for instance.
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Updated VIF entry in instance network info cache for port e13d1729-5624-4c48-8d60-2c5ff4a60c65. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Updating instance_info_cache with network_info: [{"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-162bf25b-9101-4a20-bf14-a99dee58c911 req-5d407689-faf3-4408-b8d7-cedace395c43 service nova] Releasing lock "refresh_cache-e9d65be5-6a26-48a0-9207-b66a9c0358ff" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:04 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Deleted allocations for instance 89a23062-cf16-4dd9-b6e8-7483115ca1c3
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-274f0dc4-7b29-4c92-ba06-30b2a60034ce tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "89a23062-cf16-4dd9-b6e8-7483115ca1c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.163s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:04 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:18:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a83aea-dce7-4817-abf4-f8eba354d6b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dc301b-54e2-48e6-844c-c1e5945baacf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[59852da9-2113-44c7-b43b-f539ad0e626b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea51c0-ce5f-440c-b6c2-6045cc914fbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:18:07 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aeb120-aa9f-436a-9259-4f54a2f2cb55]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG os_brick.utils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Updating existing volume attachment record: 7307bb10-8b5c-41fa-825f-76116eeec479 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:18:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:08 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7716MB free_disk=24.76242446899414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 203ff896-ed38-4378-9146-075fb92cf657 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d10e0d60-288a-41e7-865f-01fe514ab7d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance e9d65be5-6a26-48a0-9207-b66a9c0358ff actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:18:08 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:18:09 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:18:09 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:18:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:18:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.794s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Skipping network cache update for instance because it is Building. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid f13a1f06-0c06-46df-b958-bfc33d6272fa {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [{"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-f13a1f06-0c06-46df-b958-bfc33d6272fa" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:18:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:18:14 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Creating image(s)
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Ensure instance console log exists: /opt/stack/data/nova/instances/e9d65be5-6a26-48a0-9207-b66a9c0358ff/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Start _get_guest_xml network_info=[{"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '7307bb10-8b5c-41fa-825f-76116eeec479', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgdDfrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e9d65be5-6a26-48a0-9207-b66a9c0358ff', 'attached_at': '', 'detached_at': '', 'volume_id': '386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 'serial': '386b3a27-6a35-4504-b3ec-acdc7efb4ccc'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:18:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:18:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgdDfrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:18:15 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:18:15 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:18:15 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[693744a5-b09c-4e74-8762-1266b531ace6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:18:15 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baea16f-f8c3-422d-8e46-9d371ca1e3d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc] added
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67aa9b8-2390-4e8c-8c35-db3c81ac3b9a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9456cbce-05c6-4491-b9e2-e4663440dc60]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOgdDfrj {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lOgdDfrj" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe38ff6-fd51-4c76-a016-d5cf76968b16]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lOgdDfrj'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e1f4c1-aaf6-4cd2-868f-ba7e0c5c151e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b53f6-91bf-4579-b4cd-e91864286dd3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7e6de0-abbd-4853-92a5-c857c89fdec7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260]
Nov 27 23:18:15 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260] successful.
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b86746-7cc9-4a11-983f-3f59875a3b57]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8da234-78de-4020-a693-8ecc34c71380]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:15 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:15 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('36', '-', '-', 0) found on session 42 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed92c3a-66dc-4f76-8722-6bdce6d35380]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:15 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 42 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgdDfrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26666656433653736', 'path': '/dev/sde'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666656433653736', 'path': '/dev/sde'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1399781378',display_name='tempest-TestVolumeBootPattern-server-1399781378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1399781378',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-ksm7pkai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:18:02Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=e9d65be5-6a26-48a0-9207-b66a9c0358ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.objects.instance [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid e9d65be5-6a26-48a0-9207-b66a9c0358ff {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:18:16 user nova-compute[75621]:   <uuid>e9d65be5-6a26-48a0-9207-b66a9c0358ff</uuid>
Nov 27 23:18:16 user nova-compute[75621]:   <name>instance-00000024</name>
Nov 27 23:18:16 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:18:16 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:18:16 user nova-compute[75621]:   <metadata>
Nov 27 23:18:16 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:18:16 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:18:16 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-server-1399781378</nova:name>
Nov 27 23:18:16 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:18:14</nova:creationTime>
Nov 27 23:18:16 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:18:16 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:18:16 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:18:16 user nova-compute[75621]:       <nova:owner>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:18:16 user nova-compute[75621]:       </nova:owner>
Nov 27 23:18:16 user nova-compute[75621]:       <nova:ports>
Nov 27 23:18:16 user nova-compute[75621]:         <nova:port uuid="e13d1729-5624-4c48-8d60-2c5ff4a60c65">
Nov 27 23:18:16 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 23:18:16 user nova-compute[75621]:         </nova:port>
Nov 27 23:18:16 user nova-compute[75621]:       </nova:ports>
Nov 27 23:18:16 user nova-compute[75621]:     </nova:instance>
Nov 27 23:18:16 user nova-compute[75621]:   </metadata>
Nov 27 23:18:16 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:18:16 user nova-compute[75621]:     <system>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="serial">e9d65be5-6a26-48a0-9207-b66a9c0358ff</entry>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="uuid">e9d65be5-6a26-48a0-9207-b66a9c0358ff</entry>
Nov 27 23:18:16 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:18:16 user nova-compute[75621]:     </system>
Nov 27 23:18:16 user nova-compute[75621]:   </sysinfo>
Nov 27 23:18:16 user nova-compute[75621]:   <os>
Nov 27 23:18:16 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:18:16 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:18:16 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:18:16 user nova-compute[75621]:   </os>
Nov 27 23:18:16 user nova-compute[75621]:   <features>
Nov 27 23:18:16 user nova-compute[75621]:     <acpi/>
Nov 27 23:18:16 user nova-compute[75621]:     <apic/>
Nov 27 23:18:16 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:18:16 user nova-compute[75621]:   </features>
Nov 27 23:18:16 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:18:16 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:18:16 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:18:16 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:18:16 user nova-compute[75621]:   </clock>
Nov 27 23:18:16 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:18:16 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:18:16 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:18:16 user nova-compute[75621]:   </cpu>
Nov 27 23:18:16 user nova-compute[75621]:   <devices>
Nov 27 23:18:16 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:18:16 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:18:16 user nova-compute[75621]:       <source dev="/dev/sde"/>
Nov 27 23:18:16 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:18:16 user nova-compute[75621]:       <serial>386b3a27-6a35-4504-b3ec-acdc7efb4ccc</serial>
Nov 27 23:18:16 user nova-compute[75621]:     </disk>
Nov 27 23:18:16 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:18:16 user nova-compute[75621]:       <mac address="fa:16:3e:69:c9:ed"/>
Nov 27 23:18:16 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:18:16 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:18:16 user nova-compute[75621]:       <target dev="tape13d1729-56"/>
Nov 27 23:18:16 user nova-compute[75621]:     </interface>
Nov 27 23:18:16 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:18:16 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/e9d65be5-6a26-48a0-9207-b66a9c0358ff/console.log" append="off"/>
Nov 27 23:18:16 user nova-compute[75621]:     </serial>
Nov 27 23:18:16 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:18:16 user nova-compute[75621]:     <video>
Nov 27 23:18:16 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:18:16 user nova-compute[75621]:     </video>
Nov 27 23:18:16 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:18:16 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:18:16 user nova-compute[75621]:     </rng>
Nov 27 23:18:16 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:18:16 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:18:16 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:18:16 user nova-compute[75621]:     </memballoon>
Nov 27 23:18:16 user nova-compute[75621]:   </devices>
Nov 27 23:18:16 user nova-compute[75621]: </domain>
Nov 27 23:18:16 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1399781378',display_name='tempest-TestVolumeBootPattern-server-1399781378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1399781378',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-ksm7pkai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:18:02Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=e9d65be5-6a26-48a0-9207-b66a9c0358ff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG os_vif [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2e772b6-283b-5db1-b82d-eca7d6ee49b0', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape13d1729-56, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape13d1729-56, col_values=(('qos', UUID('efda12cf-68cb-4652-8f8c-72856fa2599a')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape13d1729-56, col_values=(('external_ids', {'iface-id': 'e13d1729-5624-4c48-8d60-2c5ff4a60c65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c9:ed', 'vm-uuid': 'e9d65be5-6a26-48a0-9207-b66a9c0358ff'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:16 user nova-compute[75621]: INFO os_vif [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56')
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:18:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:69:c9:ed, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] No waiting events found dispatching network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:17 user nova-compute[75621]: WARNING nova.compute.manager [req-e6796a21-3de8-456b-a029-55be76b474dd req-cd92e751-c266-4e90-9473-3c25b4b4cbc7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received unexpected event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 for instance with vm_state building and task_state spawning.
Nov 27 23:18:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:18:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Instance spawned successfully.
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] No waiting events found dispatching network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:19 user nova-compute[75621]: WARNING nova.compute.manager [req-7d1446b1-6b73-4ca1-97fb-600b3706807b req-760d2994-2f4e-4f76-ae6e-9cbc2373fab4 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received unexpected event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 for instance with vm_state building and task_state spawning.
Nov 27 23:18:19 user nova-compute[75621]: INFO nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 27 23:18:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:18:20 user nova-compute[75621]: INFO nova.compute.manager [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Took 18.98 seconds to build instance.
Nov 27 23:18:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-71712e40-0241-4ca0-b8e1-44929a3009f6 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.070s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing instance network info cache due to event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'flavor' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updated VIF entry in instance network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG nova.network.neutron [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fd964d80-67ec-435e-9870-ef478ba18964 req-ece3a3f0-a2ec-4850-a67a-3a8661c13f89 service nova] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:38 user nova-compute[75621]: INFO nova.compute.manager [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Attaching volume b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e to /dev/vdb
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.utils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb8c373-b7c0-413a-8058-36b3cf860d37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5579aff-57ae-49d0-b335-d1d19b75d83f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698936f-682a-4029-8515-94cb3ecfbe21]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95284363-0fcd-448a-949f-d613900280b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:18:38 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:18:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac40b8-a1f0-4f86-bfaf-53ae1cdfd0e9]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG os_brick.utils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:18:38 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating existing volume attachment record: 83cb4012-586b-4eb3-8f1e-bd86c0c19249 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:18:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsNkBXcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:18:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:18:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:18:45 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc89fcd2-3a26-482c-ae35-a0e7ff8737b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:18:45 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae73cd1d-e256-47e7-82f4-6f552cdfb36b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e] added
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722d03e-bf66-4191-86cd-ba98497d3d42]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28894a5-bfa6-44c5-a89b-459f35705083]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsNkBXcE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CsNkBXcE" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e953fc-597c-4c0f-8b12-cc447168c0cf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CsNkBXcE'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cda9c9b-f649-45f2-b0c1-f2e7269d396a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2bfb1c-8c40-4486-b123-3a840b27a8b8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9817229-5bf2-4f06-8647-c15e9905782f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260]
Nov 27 23:18:45 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260] successful.
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4bd7b0-1505-47a9-8ae6-4acec415ae12]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec9b31e-5f06-4c53-bbea-925174f437fa]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:18:45 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:18:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] HCTL ('37', '-', '-', 0) found on session 43 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6197cb-58de-4a27-a34d-cb95f945358e]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching for a device in session 43 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:18:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsNkBXcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23935366535663061', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935366535663061', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.objects.instance [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'flavor' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:18:46 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:18:46 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:18:46 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:18:46 user nova-compute[75621]:   <serial>b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e</serial>
Nov 27 23:18:46 user nova-compute[75621]: </disk>
Nov 27 23:18:46 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:18:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:12:23:98, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:18:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-0f6af094-75cf-491d-aa36-7af1ca31d5fb tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.904s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:48 user nova-compute[75621]: INFO nova.compute.manager [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Rescuing
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:48 user nova-compute[75621]: WARNING nova.compute.manager [req-e48ab3c9-2cdd-4260-93eb-b525b1c7eebd req-688b6dd9-0d7f-4c3d-9f69-4248f778dbd4 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state rescuing.
Nov 27 23:18:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance destroyed successfully.
Nov 27 23:18:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Attempting rescue
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75621) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance directory exists: not creating {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 27 23:18:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Creating image(s)
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'trusted_certs' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue" returned: 0 in 0.054s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'migration_context' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<ec98e368-8ca4-45ce-8e68-4e49bc3a6f69> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start _get_guest_xml network_info=[{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:12:23:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<ec98e368-8ca4-45ce-8e68-4e49bc3a6f69> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'numa_topology' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<ec98e368-8ca4-45ce-8e68-4e49bc3a6f69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:49 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:49 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'vcpu_model' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<ec98e368-8ca4-45ce-8e68-4e49bc3a6f69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1787616905',display_name='tempest-ServerRescueNegativeTestJSON-server-1787616905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1787616905',id=33,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS0ZwCHXZAnAR6OYHa6naOHeK2boGFA0IKffVC80SngxVY1SyQMcK2omJDuPeINGk2K/mtCUlyxFnPRUx6wJ8EC9epWvHYo0YwlCOb83aw4u90rQ7Q4PnW+SBU0DAipng==',key_name='tempest-keypair-950122851',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:16:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-6guz2f5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=ec98e368-8ca4-45ce-8e68-4e49bc3a6f69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:12:23:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "vif_mac": "fa:16:3e:12:23:98"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'pci_devices' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.objects.base [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Object Instance<ec98e368-8ca4-45ce-8e68-4e49bc3a6f69> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:18:49 user nova-compute[75621]:   <uuid>ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</uuid>
Nov 27 23:18:49 user nova-compute[75621]:   <name>instance-00000021</name>
Nov 27 23:18:49 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:18:49 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:18:49 user nova-compute[75621]:   <metadata>
Nov 27 23:18:49 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:18:49 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1787616905</nova:name>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:18:49</nova:creationTime>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:18:49 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:18:49 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:owner>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:user uuid="3ef6cc601c4e455595057cb4d0dc33b7">tempest-ServerRescueNegativeTestJSON-1406378656-project-member</nova:user>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:project uuid="c0c922ea90054fc0b2220e2431ea900b">tempest-ServerRescueNegativeTestJSON-1406378656</nova:project>
Nov 27 23:18:49 user nova-compute[75621]:       </nova:owner>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:18:49 user nova-compute[75621]:       <nova:ports>
Nov 27 23:18:49 user nova-compute[75621]:         <nova:port uuid="981040bc-bd4a-4b8c-9444-d104e09cc3ed">
Nov 27 23:18:49 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 27 23:18:49 user nova-compute[75621]:         </nova:port>
Nov 27 23:18:49 user nova-compute[75621]:       </nova:ports>
Nov 27 23:18:49 user nova-compute[75621]:     </nova:instance>
Nov 27 23:18:49 user nova-compute[75621]:   </metadata>
Nov 27 23:18:49 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:18:49 user nova-compute[75621]:     <system>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="serial">ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</entry>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="uuid">ec98e368-8ca4-45ce-8e68-4e49bc3a6f69</entry>
Nov 27 23:18:49 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:18:49 user nova-compute[75621]:     </system>
Nov 27 23:18:49 user nova-compute[75621]:   </sysinfo>
Nov 27 23:18:49 user nova-compute[75621]:   <os>
Nov 27 23:18:49 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:18:49 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:18:49 user nova-compute[75621]:   </os>
Nov 27 23:18:49 user nova-compute[75621]:   <features>
Nov 27 23:18:49 user nova-compute[75621]:     <acpi/>
Nov 27 23:18:49 user nova-compute[75621]:     <apic/>
Nov 27 23:18:49 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:18:49 user nova-compute[75621]:   </features>
Nov 27 23:18:49 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:18:49 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:18:49 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:18:49 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:18:49 user nova-compute[75621]:   </clock>
Nov 27 23:18:49 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:18:49 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:18:49 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:18:49 user nova-compute[75621]:   </cpu>
Nov 27 23:18:49 user nova-compute[75621]:   <devices>
Nov 27 23:18:49 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:18:49 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:18:49 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue"/>
Nov 27 23:18:49 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:18:49 user nova-compute[75621]:     </disk>
Nov 27 23:18:49 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:18:49 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:18:49 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk"/>
Nov 27 23:18:49 user nova-compute[75621]:       <target dev="vdb" bus="virtio"/>
Nov 27 23:18:49 user nova-compute[75621]:     </disk>
Nov 27 23:18:49 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:18:49 user nova-compute[75621]:       <mac address="fa:16:3e:12:23:98"/>
Nov 27 23:18:49 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:18:49 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:18:49 user nova-compute[75621]:       <target dev="tap981040bc-bd"/>
Nov 27 23:18:49 user nova-compute[75621]:     </interface>
Nov 27 23:18:49 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:18:49 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/console.log" append="off"/>
Nov 27 23:18:49 user nova-compute[75621]:     </serial>
Nov 27 23:18:49 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:18:49 user nova-compute[75621]:     <video>
Nov 27 23:18:49 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:18:49 user nova-compute[75621]:     </video>
Nov 27 23:18:49 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:18:49 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:18:49 user nova-compute[75621]:     </rng>
Nov 27 23:18:49 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:18:49 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:18:49 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:18:49 user nova-compute[75621]:     </memballoon>
Nov 27 23:18:49 user nova-compute[75621]:   </devices>
Nov 27 23:18:49 user nova-compute[75621]: </domain>
Nov 27 23:18:49 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:18:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance destroyed successfully.
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:18:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] No VIF found with MAC fa:16:3e:12:23:98, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:18:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:50 user nova-compute[75621]: WARNING nova.compute.manager [req-c5cf95c6-5bbc-484a-b615-f60af0156678 req-d2aae9cb-9792-4f8a-bd95-cfc54283f6d3 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state rescuing.
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:51 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:52 user nova-compute[75621]: INFO nova.compute.manager [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Terminating instance
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:52 user nova-compute[75621]: WARNING nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state rescuing.
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:52 user nova-compute[75621]: WARNING nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state rescuing.
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG nova.compute.manager [req-f9a19f40-e391-4e9f-883c-feb5a55bb76a req-4d91ecbe-76a1-450b-94df-fbc4be9b4a79 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.compute.manager [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Unshelving
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Instance destroyed successfully.
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid 0f0eef2e-b116-4f58-a23a-af764f533bf9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:09:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-377140387',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-377140387',id=25,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-yyqt3klk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:11:26Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=0f0eef2e-b116-4f58-a23a-af764f533bf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "address": "fa:16:3e:1c:12:fa", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa556b0ae-7e", "ovs_interfaceid": "a556b0ae-7e6d-49bf-991e-97e284bcb79f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG os_vif [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ff2235f0-2d4f-437a-8681-6dc14244cb81 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa556b0ae-7e, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e791d87-6248-476c-91ae-3133978afa0f) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_requests' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:18:53 user nova-compute[75621]: INFO os_vif [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:12:fa,bridge_name='br-int',has_traffic_filtering=True,id=a556b0ae-7e6d-49bf-991e-97e284bcb79f,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa556b0ae-7e')
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Deleting instance files /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9_del
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Deletion of /opt/stack/data/nova/instances/0f0eef2e-b116-4f58-a23a-af764f533bf9_del complete
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.compute.claims [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Claim successful on node user
Nov 27 23:18:53 user nova-compute[75621]: INFO nova.compute.manager [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 27 23:18:53 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:18:53 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: INFO nova.network.neutron [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating port a6651aae-e6ab-4ed2-b317-61ce769e64b2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:54 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Took 0.80 seconds to deallocate network for instance.
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-5f91e40d-0ad0-452b-a2da-a864a7440c72 req-d9dbab33-1bb9-463d-89c2-a744a442dd10 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-deleted-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: INFO nova.compute.manager [req-5f91e40d-0ad0-452b-a2da-a864a7440c72 req-d9dbab33-1bb9-463d-89c2-a744a442dd10 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Neutron deleted interface a556b0ae-7e6d-49bf-991e-97e284bcb79f; detaching it from the instance and deleting it from the info cache
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.network.neutron [req-5f91e40d-0ad0-452b-a2da-a864a7440c72 req-d9dbab33-1bb9-463d-89c2-a744a442dd10 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-5f91e40d-0ad0-452b-a2da-a864a7440c72 req-d9dbab33-1bb9-463d-89c2-a744a442dd10 service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Detach interface failed, port_id=a556b0ae-7e6d-49bf-991e-97e284bcb79f, reason: Instance 0f0eef2e-b116-4f58-a23a-af764f533bf9 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Deleted allocations for instance 0f0eef2e-b116-4f58-a23a-af764f533bf9
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing instance network info cache due to event network-changed-a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] Acquiring lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-537c4893-e894-4519-b013-bff734ce2905 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:54 user nova-compute[75621]: WARNING nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state deleted and task_state None.
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:54 user nova-compute[75621]: WARNING nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state deleted and task_state None.
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:54 user nova-compute[75621]: WARNING nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state deleted and task_state None.
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:54 user nova-compute[75621]: WARNING nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-unplugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state deleted and task_state None.
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Acquiring lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] Lock "0f0eef2e-b116-4f58-a23a-af764f533bf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] No waiting events found dispatching network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:18:54 user nova-compute[75621]: WARNING nova.compute.manager [req-a55a579c-0c99-417a-9681-82354cfd9fa9 req-69773013-cb4e-4d16-8bca-485e07c197bf service nova] [instance: 0f0eef2e-b116-4f58-a23a-af764f533bf9] Received unexpected event network-vif-plugged-a556b0ae-7e6d-49bf-991e-97e284bcb79f for instance with vm_state deleted and task_state None.
Nov 27 23:18:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:18:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Creating image(s)
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] Acquired lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG nova.network.neutron [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Refreshing network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG nova.objects.base [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<7b4dc389-1c65-4b86-827a-fc8d6bab644c> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG nova.virt.images [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] 07212a3f-4085-4e53-a26c-3db4bcf04ad2 was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.part /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updated VIF entry in instance network info cache for port a6651aae-e6ab-4ed2-b317-61ce769e64b2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-22b64330-0553-4111-8ec7-6ba2712a04f9 req-3dcdeb96-802d-4475-b4f3-9f33632c81a5 service nova] Releasing lock "refresh_cache-7b4dc389-1c65-4b86-827a-fc8d6bab644c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.part /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.converted" returned: 0 in 0.366s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.763s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:56 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9,backing_fmt=raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9,backing_fmt=raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "01bd98b165c93872c1608d1eb41ee1ebd7bad0e9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'migration_context' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG nova.objects.base [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<7b4dc389-1c65-4b86-827a-fc8d6bab644c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:18:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Rebasing disk image.
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f -F raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:18:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:18:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:18:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f -F raw /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk" returned: 0 in 2.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Ensure instance console log exists: /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start _get_guest_xml network_info=[{"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='709a6d8c18c4733ddee4fbd4018cfd9c',container_format='bare',created_at=2023-11-27T23:17:01Z,direct_url=<?>,disk_format='qcow2',id=07212a3f-4085-4e53-a26c-3db4bcf04ad2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1220194247-shelved',owner='37829e68e182457e8df131abcebd5606',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T23:17:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:18:59 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:59 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='709a6d8c18c4733ddee4fbd4018cfd9c',container_format='bare',created_at=2023-11-27T23:17:01Z,direct_url=<?>,disk_format='qcow2',id=07212a3f-4085-4e53-a26c-3db4bcf04ad2,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1220194247-shelved',owner='37829e68e182457e8df131abcebd5606',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-27T23:17:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:18:59 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.objects.base [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<7b4dc389-1c65-4b86-827a-fc8d6bab644c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='07212a3f-4085-4e53-a26c-3db4bcf04ad2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-905213494',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:17:06.056527',shelved_host='user',shelved_image_id='07212a3f-4085-4e53-a26c-3db4bcf04ad2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:00 user nova-compute[75621]: INFO nova.compute.manager [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Terminating instance
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.objects.base [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Object Instance<7b4dc389-1c65-4b86-827a-fc8d6bab644c> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:19:00 user nova-compute[75621]:   <uuid>7b4dc389-1c65-4b86-827a-fc8d6bab644c</uuid>
Nov 27 23:19:00 user nova-compute[75621]:   <name>instance-00000020</name>
Nov 27 23:19:00 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:19:00 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:19:00 user nova-compute[75621]:   <metadata>
Nov 27 23:19:00 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:19:00 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1220194247</nova:name>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:18:59</nova:creationTime>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:19:00 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:19:00 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:owner>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:user uuid="5427c1c08da34bfead47d98f813db775">tempest-AttachVolumeShelveTestJSON-355781585-project-member</nova:user>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:project uuid="37829e68e182457e8df131abcebd5606">tempest-AttachVolumeShelveTestJSON-355781585</nova:project>
Nov 27 23:19:00 user nova-compute[75621]:       </nova:owner>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:root type="image" uuid="07212a3f-4085-4e53-a26c-3db4bcf04ad2"/>
Nov 27 23:19:00 user nova-compute[75621]:       <nova:ports>
Nov 27 23:19:00 user nova-compute[75621]:         <nova:port uuid="a6651aae-e6ab-4ed2-b317-61ce769e64b2">
Nov 27 23:19:00 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:19:00 user nova-compute[75621]:         </nova:port>
Nov 27 23:19:00 user nova-compute[75621]:       </nova:ports>
Nov 27 23:19:00 user nova-compute[75621]:     </nova:instance>
Nov 27 23:19:00 user nova-compute[75621]:   </metadata>
Nov 27 23:19:00 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:19:00 user nova-compute[75621]:     <system>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="serial">7b4dc389-1c65-4b86-827a-fc8d6bab644c</entry>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="uuid">7b4dc389-1c65-4b86-827a-fc8d6bab644c</entry>
Nov 27 23:19:00 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:19:00 user nova-compute[75621]:     </system>
Nov 27 23:19:00 user nova-compute[75621]:   </sysinfo>
Nov 27 23:19:00 user nova-compute[75621]:   <os>
Nov 27 23:19:00 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:19:00 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:19:00 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:19:00 user nova-compute[75621]:   </os>
Nov 27 23:19:00 user nova-compute[75621]:   <features>
Nov 27 23:19:00 user nova-compute[75621]:     <acpi/>
Nov 27 23:19:00 user nova-compute[75621]:     <apic/>
Nov 27 23:19:00 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:19:00 user nova-compute[75621]:   </features>
Nov 27 23:19:00 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:19:00 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:19:00 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:19:00 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:19:00 user nova-compute[75621]:   </clock>
Nov 27 23:19:00 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:19:00 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:19:00 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:19:00 user nova-compute[75621]:   </cpu>
Nov 27 23:19:00 user nova-compute[75621]:   <devices>
Nov 27 23:19:00 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:19:00 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:19:00 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk"/>
Nov 27 23:19:00 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:19:00 user nova-compute[75621]:     </disk>
Nov 27 23:19:00 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:19:00 user nova-compute[75621]:       <mac address="fa:16:3e:3c:cf:64"/>
Nov 27 23:19:00 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:19:00 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:19:00 user nova-compute[75621]:       <target dev="tapa6651aae-e6"/>
Nov 27 23:19:00 user nova-compute[75621]:     </interface>
Nov 27 23:19:00 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:19:00 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/console.log" append="off"/>
Nov 27 23:19:00 user nova-compute[75621]:     </serial>
Nov 27 23:19:00 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:19:00 user nova-compute[75621]:     <video>
Nov 27 23:19:00 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:19:00 user nova-compute[75621]:     </video>
Nov 27 23:19:00 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:19:00 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:19:00 user nova-compute[75621]:     </rng>
Nov 27 23:19:00 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:19:00 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:19:00 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:19:00 user nova-compute[75621]:     </memballoon>
Nov 27 23:19:00 user nova-compute[75621]:   </devices>
Nov 27 23:19:00 user nova-compute[75621]: </domain>
Nov 27 23:19:00 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='07212a3f-4085-4e53-a26c-3db4bcf04ad2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-905213494',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:15:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member',shelved_at='2023-11-27T23:17:06.056527',shelved_host='user',shelved_image_id='07212a3f-4085-4e53-a26c-3db4bcf04ad2'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG os_vif [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e24106b-686b-522d-a420-54d27b6c27cf', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6651aae-e6, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6651aae-e6, col_values=(('qos', UUID('e7d75336-df03-4303-a423-d7cc96aedc2e')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6651aae-e6, col_values=(('external_ids', {'iface-id': 'a6651aae-e6ab-4ed2-b317-61ce769e64b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:cf:64', 'vm-uuid': '7b4dc389-1c65-4b86-827a-fc8d6bab644c'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: INFO os_vif [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6')
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] No VIF found with MAC fa:16:3e:3c:cf:64, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-b0ff9ed0-03ea-4118-b8bc-8300cf46fc9b req-7f6706bd-731e-4c92-8a52-8a4a5cc1b15a service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-unplugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Instance destroyed successfully.
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.objects.instance [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'resources' on Instance uuid 203ff896-ed38-4378-9146-075fb92cf657 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:12:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1308485278',display_name='tempest-ServerActionsTestOtherA-server-1308485278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1308485278',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:14:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-b0i8snnc',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:16:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=203ff896-ed38-4378-9146-075fb92cf657,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "cf6eb519-6256-422e-871e-4dd93ca7711b", "address": "fa:16:3e:6e:13:bf", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf6eb519-62", "ovs_interfaceid": "cf6eb519-6256-422e-871e-4dd93ca7711b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_vif [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf6eb519-62, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3ab77ab-151e-4115-84ae-aae47632f900) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: INFO os_vif [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:13:bf,bridge_name='br-int',has_traffic_filtering=True,id=cf6eb519-6256-422e-871e-4dd93ca7711b,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf6eb519-62')
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsXpHShg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:01 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7151125-8b20-4833-82f8-6a96252defd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:19:01 user nova-compute[75621]: No targets found.
Nov 27 23:19:01 user nova-compute[75621]: iSNS:
Nov 27 23:19:01 user nova-compute[75621]: No targets found.
Nov 27 23:19:01 user nova-compute[75621]: STATIC:
Nov 27 23:19:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba
Nov 27 23:19:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:19:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:19:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc
Nov 27 23:19:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:19:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:01 user nova-compute[75621]: FIRMWARE:
Nov 27 23:19:01 user nova-compute[75621]: No targets found.
Nov 27 23:19:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:19:01 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:19:01 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[489eb4aa-b156-42d7-acdd-755c09c14b1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4fa050-1c60-423a-bb9f-c9ac30057559]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:01 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0577520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[020813aa-fc3a-4051-9d1c-12accced2dda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad8b6a-5b3d-41a4-a294-ce117edf5710]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[be18c556-d1a2-47a7-a48d-b088dc4c0941]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2329dd5-c007-4ef7-8a28-63c7084bb82f]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f232c2a-bd7c-467d-ac78-6079a6f68f48]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea229a-4d59-4d14-8754-d78cb4b64242]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260]
Nov 27 23:19:01 user nova-compute[75621]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f038b04-5d13-42e3-a726-c4b05fdba4cc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] <== disconnect_volume: return (354ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:19:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Deleting instance files /opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657_del
Nov 27 23:19:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Deletion of /opt/stack/data/nova/instances/203ff896-ed38-4378-9146-075fb92cf657_del complete
Nov 27 23:19:01 user nova-compute[75621]: INFO nova.compute.manager [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Took 1.57 seconds to destroy the instance on the hypervisor.
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] Acquiring lock "203ff896-ed38-4378-9146-075fb92cf657-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] Lock "203ff896-ed38-4378-9146-075fb92cf657-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] No waiting events found dispatching network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:02 user nova-compute[75621]: WARNING nova.compute.manager [req-807548a8-4d6f-4063-a2b0-9c9d99f7cbf0 req-bbf9c35d-1e02-4c3c-b084-41b3d350dbcf service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received unexpected event network-vif-plugged-cf6eb519-6256-422e-871e-4dd93ca7711b for instance with vm_state active and task_state deleting.
Nov 27 23:19:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:02 user nova-compute[75621]: WARNING nova.compute.manager [req-e238dfd0-079d-4787-be96-0a5c3a629aae req-a7707996-baa4-4f0f-8b31-9501c797d632 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 23:19:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:03 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:03 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Took 1.60 seconds to deallocate network for instance.
Nov 27 23:19:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:04 user nova-compute[75621]: INFO nova.compute.manager [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Took 0.80 seconds to detach 1 volumes for instance.
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Deleting volume: b16b14ac-74bb-44b9-a2af-ae8a4d66a4ba {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:19:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance spawned successfully.
Nov 27 23:19:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8c63e748-7960-47f4-b777-0258572c6340 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:04 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Deleted allocations for instance 203ff896-ed38-4378-9146-075fb92cf657
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-449dbbae-f0d7-4052-bad2-9f39107f42a6 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "203ff896-ed38-4378-9146-075fb92cf657" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.662s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] [instance: 203ff896-ed38-4378-9146-075fb92cf657] Received event network-vif-deleted-cf6eb519-6256-422e-871e-4dd93ca7711b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:05 user nova-compute[75621]: WARNING nova.compute.manager [req-52c9d677-d180-43cc-91b3-ff137cfcb4bf req-52e3cffb-5c25-4175-bb2d-88146e50988d service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state active and task_state None.
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json" returned: 0 in 0.251s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-changed-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Refreshing instance network info cache due to event network-changed-778cc220-40b0-4ac3-8901-5219cdc328f6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] Acquiring lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] Acquired lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Refreshing network info cache for port 778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updated VIF entry in instance network info cache for port 778cc220-40b0-4ac3-8901-5219cdc328f6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updating instance_info_cache with network_info: [{"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-70967f51-fbfe-44b4-aead-bf261fb19476 req-74cf9131-1d2d-4882-b8fa-a1a57ccc9ac9 service nova] Releasing lock "refresh_cache-ce4bf2e9-c666-4c68-88d4-f746ee5280d6" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:19:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:19:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=7923MB free_disk=24.882286071777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b75ec495-38b4-42ff-a489-13b76129b094 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d10e0d60-288a-41e7-865f-01fe514ab7d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance e9d65be5-6a26-48a0-9207-b66a9c0358ff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:09 user nova-compute[75621]: INFO nova.compute.manager [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Attaching volume 5ace10b0-839f-4136-9872-59feb4da8a6c to /dev/vdb
Nov 27 23:19:09 user nova-compute[75621]: DEBUG os_brick.utils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9cabe9-c270-46fc-9fc3-7d351a3ce8b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a363f2c-a149-4d41-a295-3a3104f15aa4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cbd747a-e0ec-4add-a391-98c6cd0bfcd7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d77bb-0c7c-4a52-883f-4c87a2424b7b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:19:10 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:19:10 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8bbbcd-f7c1-4ec3-9f52-09303e3c4841]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG os_brick.utils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:10 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updating existing volume attachment record: 0e834d68-f51f-4002-9c00-8d107a3300c5 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:19:11 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:19:12 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [{"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-6573b4cf-062d-4beb-b387-1f0966fd1ae8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:19:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:19:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APmMahis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:16 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:16 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:16 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bb1390-9785-4492-87f9-7ea30c9df1ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:19:16 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[760be15d-5813-4236-bfe9-83b922f71881]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c] added
Nov 27 23:19:16 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1324e6f7-d34a-406a-a7b0-1cc2a9d2d010]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0d00a-9038-4ef6-8d1e-44d41951054a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APmMahis {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APmMahis" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c4dcd-d96e-4c82-a1c9-81028de2fbc2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APmMahis'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43216d0-2392-47da-8162-33f59af6bc1e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cf91a0-8169-4263-9aa9-fc18a7230c9b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa597224-f635-4651-bc94-417b18e16174]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260]
Nov 27 23:19:17 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4adc4f2-321a-4f69-87a2-d42c2cd8e677]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6e3858-2e3f-4dc6-8a51-60b3ea7f4087]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:17 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:17 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e3f481-b330-4b1a-8fca-769170db641f]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:19:17 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APmMahis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26635666438653463', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635666438653463', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:19:18 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:19:18 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:19:18 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:19:18 user nova-compute[75621]:   <serial>5ace10b0-839f-4136-9872-59feb4da8a6c</serial>
Nov 27 23:19:18 user nova-compute[75621]: </disk>
Nov 27 23:19:18 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:a6:56:25, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:19:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d7a31c83-a6ef-437d-b0b5-5a43eec48f6f tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.013s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:19 user nova-compute[75621]: INFO nova.compute.manager [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Detaching volume 5ace10b0-839f-4136-9872-59feb4da8a6c
Nov 27 23:19:20 user nova-compute[75621]: INFO nova.virt.block_device [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Attempting to driver detach volume 5ace10b0-839f-4136-9872-59feb4da8a6c from mountpoint /dev/vdb
Nov 27 23:19:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Attempting to detach device vdb from instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:19:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:19:20 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:19:20 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:19:20 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:19:20 user nova-compute[75621]:   <serial>5ace10b0-839f-4136-9872-59feb4da8a6c</serial>
Nov 27 23:19:20 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:19:20 user nova-compute[75621]: </disk>
Nov 27 23:19:20 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:19:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 from the persistent domain config.
Nov 27 23:19:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:19:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:19:20 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:19:20 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:19:20 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:19:20 user nova-compute[75621]:   <serial>5ace10b0-839f-4136-9872-59feb4da8a6c</serial>
Nov 27 23:19:20 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:19:20 user nova-compute[75621]: </disk>
Nov 27 23:19:20 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:19:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:19:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing instance network info cache due to event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:19:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG nova.network.neutron [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated VIF entry in instance network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG nova.network.neutron [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87238923-a83f-4b58-8f16-444e7dd08fd3 req-32df3fb9-b466-47c0-94c9-0c87bf17427f service nova] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:35 user nova-compute[75621]: INFO nova.compute.manager [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Shelve offloading
Nov 27 23:19:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:36 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance destroyed successfully.
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:36 user nova-compute[75621]: WARNING nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state active and task_state shelving.
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:36 user nova-compute[75621]: WARNING nova.compute.manager [req-fe6631df-12d9-4751-82fd-3a1b29712dc5 req-335fbd03-57d8-452f-bcb3-e1ad20889844 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state active and task_state shelving.
Nov 27 23:19:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance destroyed successfully.
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'resources' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXTS2BjNbZ3FT+r/pITUL+bItthGa8a0JmXE47UIE8ULsb1xEhgqmNpq+j+DaQaCLAelEiOnnqJB2Bgu6wk+e5tW8MxxbbyzaEb6/fjTvqTMoNhayjZDF7xi8ufTvwgHw==',key_name='tempest-TestShelveInstance-1372082336',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:17:56Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_vif [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a35be82-e4, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing instance network info cache due to event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b22d4c57-e077-433c-ab9c-571f03900591) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:37 user nova-compute[75621]: INFO os_vif [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4')
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efaf0d9-f4c9-474a-9254-c79c268ef295]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:19:37 user nova-compute[75621]: No targets found.
Nov 27 23:19:37 user nova-compute[75621]: iSNS:
Nov 27 23:19:37 user nova-compute[75621]: No targets found.
Nov 27 23:19:37 user nova-compute[75621]: STATIC:
Nov 27 23:19:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c
Nov 27 23:19:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:19:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:19:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc
Nov 27 23:19:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:19:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:37 user nova-compute[75621]: FIRMWARE:
Nov 27 23:19:37 user nova-compute[75621]: No targets found.
Nov 27 23:19:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:19:37 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:19:37 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2941da56-bb9c-4377-a588-e3d72a8f535f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c8f27-3665-420a-ade8-d8e0d3537136]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:37 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07b8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06fbab7-0109-4528-bc10-023bb1bd8373]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c53f757-eb85-4405-a0d9-243c4261b643]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f86510b-e7f2-471c-8bdd-9ce74030aed6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b28b54-59dc-46f1-913a-f641771b30d3]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8bc2a9d-c8db-45fe-bf16-d5d07757ce5f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2281b7-56ed-4183-82e1-8e302b945a33]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]
Nov 27 23:19:37 user nova-compute[75621]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d59dd9-2097-4c7e-a928-ff884cd3f35a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== disconnect_volume: return (332ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:19:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deleting instance files /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8_del
Nov 27 23:19:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deletion of /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8_del complete
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated VIF entry in instance network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG nova.network.neutron [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": null, "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8a35be82-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-61cfb878-444a-4653-85a9-cfe379f7aa01 req-34c90133-accc-4dbc-9061-7ef53f2a55bc service nova] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:19:38 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Deleted allocations for instance d10e0d60-288a-41e7-865f-01fe514ab7d8
Nov 27 23:19:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'numa_topology' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:38 user nova-compute[75621]: DEBUG nova.objects.base [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Object Instance<d10e0d60-288a-41e7-865f-01fe514ab7d8> lazy-loaded attributes: resources,numa_topology {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:19:39 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:39 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e9601fee-916a-4284-a412-e3078f8e1db0 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.859s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:40 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 is timed out.
Nov 27 23:19:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 from the live domain config.
Nov 27 23:19:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APmMahis', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:40 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cd83df-6a78-411f-8909-6f6fd5489c8c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:19:40 user nova-compute[75621]: No targets found.
Nov 27 23:19:40 user nova-compute[75621]: iSNS:
Nov 27 23:19:40 user nova-compute[75621]: No targets found.
Nov 27 23:19:40 user nova-compute[75621]: STATIC:
Nov 27 23:19:40 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c
Nov 27 23:19:40 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:40 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:40 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:19:40 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:40 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:40 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc
Nov 27 23:19:40 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:40 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:40 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:19:40 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:40 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:40 user nova-compute[75621]: FIRMWARE:
Nov 27 23:19:40 user nova-compute[75621]: No targets found.
Nov 27 23:19:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:19:40 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:19:40 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bffac8d-9dde-4c56-9f6a-5a4442b547ef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92a708-c1a6-44a6-bf48-83f7f3db91d1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:40 user nova-compute[75621]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c (non-flash)
Nov 27 23:19:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0799a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bdc705-6bc0-4a3f-9025-d552c828339a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedf41cc-1e44-4690-a4ae-af2e8bb34140]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f7cd9-1960-4cc3-9447-c7d944a6c926]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980e8d4-e3d6-4f63-b370-8d83a20ba5ef]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dab16e2-c845-4440-8516-3a4bb7fa7b72]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbbc588-f864-4464-9ece-03b9fbaef4f8]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260]
Nov 27 23:19:40 user nova-compute[75621]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ace10b0-839f-4136-9872-59feb4da8a6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb96470-5d85-41db-b80f-a7972a4db4d1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== disconnect_volume: return (364ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:19:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ad5bf3aa-b2d9-4346-a185-c91fea69b49b tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:42 user nova-compute[75621]: INFO nova.compute.manager [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Terminating instance
Nov 27 23:19:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee508967-46f4-4d48-9791-42c4c6c7a71c req-26943182-a721-43c8-8e2f-a51ae8f4c015 service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-unplugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:19:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Instance destroyed successfully.
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid b75ec495-38b4-42ff-a489-13b76129b094 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:03:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-4921025',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-4921025',id=12,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:05:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-4qj2t6f2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:07:42Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=b75ec495-38b4-42ff-a489-13b76129b094,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "address": "fa:16:3e:7c:0f:22", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac7d5fc9-24", "ovs_interfaceid": "ac7d5fc9-24e0-4544-a84e-187023fd6e8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_vif [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac7d5fc9-24, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a361c5c0-5ca4-4b3d-ab18-30e4bf0edc92) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:43 user nova-compute[75621]: INFO os_vif [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:0f:22,bridge_name='br-int',has_traffic_filtering=True,id=ac7d5fc9-24e0-4544-a84e-187023fd6e8a,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac7d5fc9-24')
Nov 27 23:19:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgxoOQDU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:43 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b80cf-9703-4947-bdfa-3458e6f4bc44]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:19:43 user nova-compute[75621]: No targets found.
Nov 27 23:19:43 user nova-compute[75621]: iSNS:
Nov 27 23:19:43 user nova-compute[75621]: No targets found.
Nov 27 23:19:43 user nova-compute[75621]: STATIC:
Nov 27 23:19:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25
Nov 27 23:19:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc
Nov 27 23:19:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:43 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:19:43 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:43 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:43 user nova-compute[75621]: FIRMWARE:
Nov 27 23:19:43 user nova-compute[75621]: No targets found.
Nov 27 23:19:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:19:43 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:19:43 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[138775c1-2e01-4216-a07a-2fa385228e04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[590b90e7-0cb6-4f4d-bc9b-c6acba0eebe6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:43 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:43 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 (non-flash)
Nov 27 23:19:43 user nova-compute[75621]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:43 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:43 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13040e3490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ca3c5-a21e-41d1-9a6d-a9037bc2b958]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d986fea3-7c92-404b-95fb-ca20689a899a]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9542a403-dd53-44a9-bc63-508236ef47e0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4825fd40-b595-4870-ac44-73a7033ff9ff]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[041ecf56-7143-41db-8bb5-a55461671e73]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcff44b-f660-4614-85f8-c5b527816d1d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260]
Nov 27 23:19:44 user nova-compute[75621]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:44 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4e8520c-4c32-4d15-9ae3-7fc63e2aae25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a49928-7520-4d1b-8e78-e43f033c4e5c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] <== disconnect_volume: return (308ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:19:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Deleting instance files /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094_del
Nov 27 23:19:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Deletion of /opt/stack/data/nova/instances/b75ec495-38b4-42ff-a489-13b76129b094_del complete
Nov 27 23:19:44 user nova-compute[75621]: INFO nova.compute.manager [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 27 23:19:44 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:44 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Took 0.39 seconds to deallocate network for instance.
Nov 27 23:19:45 user nova-compute[75621]: INFO nova.compute.manager [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Took 0.72 seconds to detach 1 volumes for instance.
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] Acquiring lock "b75ec495-38b4-42ff-a489-13b76129b094-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] Lock "b75ec495-38b4-42ff-a489-13b76129b094-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] No waiting events found dispatching network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:45 user nova-compute[75621]: WARNING nova.compute.manager [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received unexpected event network-vif-plugged-ac7d5fc9-24e0-4544-a84e-187023fd6e8a for instance with vm_state deleted and task_state None.
Nov 27 23:19:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4e6646d-2e45-4c1c-a6eb-691091158c2b req-e5794b51-b297-4af0-87ac-7c6e63eae6fd service nova] [instance: b75ec495-38b4-42ff-a489-13b76129b094] Received event network-vif-deleted-ac7d5fc9-24e0-4544-a84e-187023fd6e8a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:45 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Deleted allocations for instance b75ec495-38b4-42ff-a489-13b76129b094
Nov 27 23:19:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b45aea28-a41e-4347-97e5-00fbdfe58b8f tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "b75ec495-38b4-42ff-a489-13b76129b094" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.735s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:51 user nova-compute[75621]: INFO nova.compute.manager [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Terminating instance
Nov 27 23:19:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-unplugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] No waiting events found dispatching network-vif-unplugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-a2b91819-d451-4172-b4da-4dddde2debf5 req-8176fa11-d137-4408-8c2b-144f1acc7750 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-unplugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:19:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Instance destroyed successfully.
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid e9d65be5-6a26-48a0-9207-b66a9c0358ff {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:18:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1399781378',display_name='tempest-TestVolumeBootPattern-server-1399781378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1399781378',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-ksm7pkai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:18:20Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=e9d65be5-6a26-48a0-9207-b66a9c0358ff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "address": "fa:16:3e:69:c9:ed", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape13d1729-56", "ovs_interfaceid": "e13d1729-5624-4c48-8d60-2c5ff4a60c65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_vif [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape13d1729-56, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=efda12cf-68cb-4652-8f8c-72856fa2599a) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:52 user nova-compute[75621]: INFO os_vif [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c9:ed,bridge_name='br-int',has_traffic_filtering=True,id=e13d1729-5624-4c48-8d60-2c5ff4a60c65,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape13d1729-56')
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lOgdDfrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:19:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89e155e-bea6-4324-9270-3094c1f81bba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:19:52 user nova-compute[75621]: No targets found.
Nov 27 23:19:52 user nova-compute[75621]: iSNS:
Nov 27 23:19:52 user nova-compute[75621]: No targets found.
Nov 27 23:19:52 user nova-compute[75621]: STATIC:
Nov 27 23:19:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc
Nov 27 23:19:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:52 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:19:52 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:19:52 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:19:52 user nova-compute[75621]: FIRMWARE:
Nov 27 23:19:52 user nova-compute[75621]: No targets found.
Nov 27 23:19:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:19:52 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:19:52 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc94783-b48c-4ccd-8c07-64ac293c9f28]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fff6fb9-a80b-41ed-860f-73f51830e946]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:52 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc (non-flash)
Nov 27 23:19:52 user nova-compute[75621]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:19:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130062c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc'): ({'sde'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sde {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2c27f-e024-4741-8cda-4e1c6bbfe97c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c688b5f-065d-4b3e-aff1-32625f1e213e]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sde {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ca5b70-5454-43c7-841e-cebff4db0fe5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e381611-b864-46d4-99b3-6cb3903e1d8b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sde have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_28b3584d', '/dev/disk/by-id/scsi-1SCST_BIO28b3584d-ffed3e769e5b5e32', '/dev/disk/by-id/scsi-26666656433653736') {{(pid=86804) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e108a1-43c3-46f5-b828-ab3ac0755cb0]: (4, None) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ec680-1b4b-474d-b9bc-17f63b8d911a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e89be97-e4d2-42dc-a983-40104b59e154]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260]
Nov 27 23:19:52 user nova-compute[75621]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc, portal: 172.16.0.220,3260] successful.
Nov 27 23:19:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:386b3a27-6a35-4504-b3ec-acdc7efb4ccc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4435d8e-2dea-4a20-ba45-39e96135a0e4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (309ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:19:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Deleting instance files /opt/stack/data/nova/instances/e9d65be5-6a26-48a0-9207-b66a9c0358ff_del
Nov 27 23:19:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Deletion of /opt/stack/data/nova/instances/e9d65be5-6a26-48a0-9207-b66a9c0358ff_del complete
Nov 27 23:19:52 user nova-compute[75621]: INFO nova.compute.manager [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 27 23:19:52 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:19:52 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:53 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Took 0.40 seconds to deallocate network for instance.
Nov 27 23:19:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fec9a92-cf50-4e8a-96ac-49302042b175 req-5916b64d-8551-4221-befb-59477c14435d service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-deleted-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:53 user nova-compute[75621]: INFO nova.compute.manager [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Terminating instance
Nov 27 23:19:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] Acquiring lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] No waiting events found dispatching network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:53 user nova-compute[75621]: WARNING nova.compute.manager [req-f599f05d-3823-401b-bc92-14ff5dd76518 req-45e9e790-ee1d-40a6-a8d0-13d85c586aa7 service nova] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Received unexpected event network-vif-plugged-e13d1729-5624-4c48-8d60-2c5ff4a60c65 for instance with vm_state active and task_state deleting.
Nov 27 23:19:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.compute.manager [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Took 0.83 seconds to detach 1 volumes for instance.
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: e9d65be5-6a26-48a0-9207-b66a9c0358ff] Deleting volume: 386b3a27-6a35-4504-b3ec-acdc7efb4ccc {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance e9d65be5-6a26-48a0-9207-b66a9c0358ff
Nov 27 23:19:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-da854f1d-0a33-43a3-8fe9-9d4e0ad4f830 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "e9d65be5-6a26-48a0-9207-b66a9c0358ff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.968s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Instance destroyed successfully.
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lazy-loading 'resources' on Instance uuid 6573b4cf-062d-4beb-b387-1f0966fd1ae8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-50549532',display_name='tempest-ServerActionsTestOtherA-server-50549532',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-50549532',id=5,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbvksbO9BNP98rMcgtayKiRYSeaBCvXllezvEoPNM7icg8vI/T9eEadw1BrxHYdSHOA5C9FPKKxEINDMXhiPvhdFunC/63s6ZNtAmLNf+8RL0ns/FcxkHmfNZ2pyDZ5KQ==',key_name='tempest-keypair-1447011584',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7af3c98f53504bd39917790819b9bae6',ramdisk_id='',reservation_id='r-7o8rdluc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1166847266',owner_user_name='tempest-ServerActionsTestOtherA-1166847266-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4cbbd5877014527889b23cd592da5f0',uuid=6573b4cf-062d-4beb-b387-1f0966fd1ae8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converting VIF {"id": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "address": "fa:16:3e:2a:9e:82", "network": {"id": "cbf4b34d-14a4-4aeb-95b4-2e192ce2213f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-781523245-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7af3c98f53504bd39917790819b9bae6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5032c209-ff", "ovs_interfaceid": "5032c209-fff8-4169-bf18-7b6a18a53d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG os_vif [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5032c209-ff, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0c7fefb-f74a-4935-88d3-079148eded91) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:19:54 user nova-compute[75621]: INFO os_vif [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:9e:82,bridge_name='br-int',has_traffic_filtering=True,id=5032c209-fff8-4169-bf18-7b6a18a53d1a,network=Network(cbf4b34d-14a4-4aeb-95b4-2e192ce2213f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5032c209-ff')
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Deleting instance files /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8_del
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Deletion of /opt/stack/data/nova/instances/6573b4cf-062d-4beb-b387-1f0966fd1ae8_del complete
Nov 27 23:19:54 user nova-compute[75621]: INFO nova.compute.manager [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 23:19:54 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:19:54 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:19:55 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Took 0.44 seconds to deallocate network for instance.
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-vif-unplugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] No waiting events found dispatching network-vif-unplugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:55 user nova-compute[75621]: WARNING nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received unexpected event network-vif-unplugged-5032c209-fff8-4169-bf18-7b6a18a53d1a for instance with vm_state deleted and task_state None.
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Acquiring lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] No waiting events found dispatching network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:19:55 user nova-compute[75621]: WARNING nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received unexpected event network-vif-plugged-5032c209-fff8-4169-bf18-7b6a18a53d1a for instance with vm_state deleted and task_state None.
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-40ddd7dd-0c5a-445b-8e0a-a22531035fd2 req-7df6f286-1e5f-463f-92bf-8e385e72a200 service nova] [instance: 6573b4cf-062d-4beb-b387-1f0966fd1ae8] Received event network-vif-deleted-5032c209-fff8-4169-bf18-7b6a18a53d1a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:55 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Deleted allocations for instance 6573b4cf-062d-4beb-b387-1f0966fd1ae8
Nov 27 23:19:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36d77824-3cb3-469a-ba8e-f460d0551b74 tempest-ServerActionsTestOtherA-1166847266 tempest-ServerActionsTestOtherA-1166847266-project-member] Lock "6573b4cf-062d-4beb-b387-1f0966fd1ae8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.759s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:19:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:19:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:19:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:05 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:06 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:20:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8129MB free_disk=24.899791717529297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance f13a1f06-0c06-46df-b958-bfc33d6272fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:10 user nova-compute[75621]: INFO nova.compute.manager [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Terminating instance
Nov 27 23:20:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-276bf87e-f20d-4c70-a121-027122d5d7c9 req-214d4aa8-c5ef-45aa-97c7-b41f51ad3f87 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Instance destroyed successfully.
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'resources' on Instance uuid ce4bf2e9-c666-4c68-88d4-f746ee5280d6 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:17:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1190946677',display_name='tempest-AttachVolumeNegativeTest-server-1190946677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1190946677',id=34,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGneCw1Git/2AmqG9mWiHn/ZSpzcN+eVREW7+3oYDfargWhk8ScV+0uERkXGbRCxgMx+3LZ0mMTrmje0sVtvxHUSs7PqJFiV0CT2rAxDfmChsUMiPJ2roxhNCfNoRbahzg==',key_name='tempest-keypair-60551326',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:17:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-iql5ip94',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:17:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=ce4bf2e9-c666-4c68-88d4-f746ee5280d6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "778cc220-40b0-4ac3-8901-5219cdc328f6", "address": "fa:16:3e:a6:56:25", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap778cc220-40", "ovs_interfaceid": "778cc220-40b0-4ac3-8901-5219cdc328f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG os_vif [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap778cc220-40, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a46dc4fd-6e49-44bb-903c-129276046ed6) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:11 user nova-compute[75621]: INFO os_vif [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:56:25,bridge_name='br-int',has_traffic_filtering=True,id=778cc220-40b0-4ac3-8901-5219cdc328f6,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap778cc220-40')
Nov 27 23:20:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Deleting instance files /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6_del
Nov 27 23:20:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Deletion of /opt/stack/data/nova/instances/ce4bf2e9-c666-4c68-88d4-f746ee5280d6_del complete
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: INFO nova.compute.manager [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 23:20:11 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:12 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Took 1.35 seconds to deallocate network for instance.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:12 user nova-compute[75621]: WARNING nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state deleted and task_state None.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:12 user nova-compute[75621]: WARNING nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state deleted and task_state None.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:12 user nova-compute[75621]: WARNING nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state deleted and task_state None.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:12 user nova-compute[75621]: WARNING nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-unplugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state deleted and task_state None.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Acquiring lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] No waiting events found dispatching network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:12 user nova-compute[75621]: WARNING nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received unexpected event network-vif-plugged-778cc220-40b0-4ac3-8901-5219cdc328f6 for instance with vm_state deleted and task_state None.
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-fe32b046-12f6-4cf9-91d1-0abca768e09a req-ff13a58c-6585-423f-966a-61f14be827d0 service nova] [instance: ce4bf2e9-c666-4c68-88d4-f746ee5280d6] Received event network-vif-deleted-778cc220-40b0-4ac3-8901-5219cdc328f6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Deleted allocations for instance ce4bf2e9-c666-4c68-88d4-f746ee5280d6
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3099eb2d-3aed-4184-ada9-eee0c5550924 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "ce4bf2e9-c666-4c68-88d4-f746ee5280d6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.613s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:20:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:20:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:20:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:20:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:33 user nova-compute[75621]: INFO nova.compute.manager [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Terminating instance
Nov 27 23:20:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-unplugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] No waiting events found dispatching network-vif-unplugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-473ffafa-3e20-4127-9be1-f52351a22db9 req-1d281176-fda3-4cc6-b581-c8773721920f service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-unplugged-057da8d3-ad29-4b83-914e-44bb4bda7361 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Instance destroyed successfully.
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lazy-loading 'resources' on Instance uuid f13a1f06-0c06-46df-b958-bfc33d6272fa {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:00:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1500141362',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1500141362',id=3,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:01:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef81acb6ed764a23a83269df20981c46',ramdisk_id='',reservation_id='r-womi1fjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:02:51Z,user_data=None,user_id='506743bc2ab54538b400595de8792b5d',uuid=f13a1f06-0c06-46df-b958-bfc33d6272fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converting VIF {"id": "057da8d3-ad29-4b83-914e-44bb4bda7361", "address": "fa:16:3e:bc:81:4d", "network": {"id": "452e44d2-0a2b-4159-b420-8c9d2bc87921", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1990900435-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef81acb6ed764a23a83269df20981c46", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap057da8d3-ad", "ovs_interfaceid": "057da8d3-ad29-4b83-914e-44bb4bda7361", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG os_vif [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap057da8d3-ad, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9afa1a62-c0b9-40ca-a612-ca79ba2daf1f) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:34 user nova-compute[75621]: INFO os_vif [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:81:4d,bridge_name='br-int',has_traffic_filtering=True,id=057da8d3-ad29-4b83-914e-44bb4bda7361,network=Network(452e44d2-0a2b-4159-b420-8c9d2bc87921),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap057da8d3-ad')
Nov 27 23:20:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Deleting instance files /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa_del
Nov 27 23:20:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Deletion of /opt/stack/data/nova/instances/f13a1f06-0c06-46df-b958-bfc33d6272fa_del complete
Nov 27 23:20:34 user nova-compute[75621]: INFO nova.compute.manager [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 23:20:34 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:20:34 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:34 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Took 0.38 seconds to deallocate network for instance.
Nov 27 23:20:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-9c0f55b7-9f80-4da8-8908-2dd2cbbf4b4c req-49f74682-4039-4bbf-8eb5-f7a39a1bc385 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-deleted-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:35 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:20:35 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:20:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:35 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Deleted allocations for instance f13a1f06-0c06-46df-b958-bfc33d6272fa
Nov 27 23:20:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8918c478-b393-454e-8313-1e7f55864b42 tempest-ServerBootFromVolumeStableRescueTest-1640168355 tempest-ServerBootFromVolumeStableRescueTest-1640168355-project-member] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.624s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] Acquiring lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] Lock "f13a1f06-0c06-46df-b958-bfc33d6272fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] No waiting events found dispatching network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:36 user nova-compute[75621]: WARNING nova.compute.manager [req-c25e52ac-59bc-4ffd-92e7-1dfd15ed852c req-2ce49071-6606-459e-8a7f-25bdf5aed781 service nova] [instance: f13a1f06-0c06-46df-b958-bfc33d6272fa] Received unexpected event network-vif-plugged-057da8d3-ad29-4b83-914e-44bb4bda7361 for instance with vm_state deleted and task_state None.
Nov 27 23:20:38 user nova-compute[75621]: INFO nova.compute.manager [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Unrescuing
Nov 27 23:20:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:20:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:20:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG nova.network.neutron [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'flavor' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:39 user nova-compute[75621]: WARNING nova.compute.manager [req-c5a534fd-0117-489a-80be-f9a1a3fec5de req-f68ef172-b1fb-4c27-a409-1acee4b58730 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:20:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance destroyed successfully.
Nov 27 23:20:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:41 user nova-compute[75621]: WARNING nova.compute.manager [req-c2a72d9a-0599-4aa9-b22f-4f787000c23e req-a5960836-b7a1-404d-bd1f-87abe0cdd885 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state rescued and task_state unrescuing.
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:43 user nova-compute[75621]: INFO nova.compute.manager [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Terminating instance
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-208078a7-4d16-4fcb-8f5b-369542e9e55a tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:43 user nova-compute[75621]: WARNING nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state None.
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:43 user nova-compute[75621]: WARNING nova.compute.manager [req-da587b01-4736-4904-af59-f57519487c46 req-f995c8ac-ab4e-485e-9b4a-d5b413443d15 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state None.
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-9016a142-b6eb-4671-97f0-afecf784fbab req-13f19639-5990-4c5e-8d23-06197f9db0c5 service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-unplugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:20:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Instance destroyed successfully.
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lazy-loading 'resources' on Instance uuid 7b4dc389-1c65-4b86-827a-fc8d6bab644c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1220194247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1220194247',id=32,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFET04Pr4JasiQs0bEYmtK0++Dj80KCh7ZsPwryHdlNYA/AKOTcE3TOJqbKBil0AZN45judq2NOFk02C1/wxdXKHPYWpAkgZYOJZBR5JFEbI7EGa1enDsOzISAIQdAfmA==',key_name='tempest-keypair-905213494',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:19:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='37829e68e182457e8df131abcebd5606',ramdisk_id='',reservation_id='r-wuwy3bue',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-355781585',owner_user_name='tempest-AttachVolumeShelveTestJSON-355781585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:19:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5427c1c08da34bfead47d98f813db775',uuid=7b4dc389-1c65-4b86-827a-fc8d6bab644c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converting VIF {"id": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "address": "fa:16:3e:3c:cf:64", "network": {"id": "01e80e3a-0cda-47f3-9a89-09b3336f8b4a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1574913808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "37829e68e182457e8df131abcebd5606", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6651aae-e6", "ovs_interfaceid": "a6651aae-e6ab-4ed2-b317-61ce769e64b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG os_vif [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6651aae-e6, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7d75336-df03-4303-a423-d7cc96aedc2e) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:20:44 user nova-compute[75621]: INFO os_vif [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:cf:64,bridge_name='br-int',has_traffic_filtering=True,id=a6651aae-e6ab-4ed2-b317-61ce769e64b2,network=Network(01e80e3a-0cda-47f3-9a89-09b3336f8b4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6651aae-e6')
Nov 27 23:20:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Deleting instance files /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c_del
Nov 27 23:20:44 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Deletion of /opt/stack/data/nova/instances/7b4dc389-1c65-4b86-827a-fc8d6bab644c_del complete
Nov 27 23:20:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:44 user nova-compute[75621]: INFO nova.compute.manager [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 27 23:20:44 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:20:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:44 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Took 0.74 seconds to deallocate network for instance.
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:45 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Deleted allocations for instance 7b4dc389-1c65-4b86-827a-fc8d6bab644c
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40c397f0-1362-4b02-af33-82a7cb00a9c6 tempest-AttachVolumeShelveTestJSON-355781585 tempest-AttachVolumeShelveTestJSON-355781585-project-member] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] Acquiring lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] Lock "7b4dc389-1c65-4b86-827a-fc8d6bab644c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] No waiting events found dispatching network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:20:45 user nova-compute[75621]: WARNING nova.compute.manager [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received unexpected event network-vif-plugged-a6651aae-e6ab-4ed2-b317-61ce769e64b2 for instance with vm_state deleted and task_state None.
Nov 27 23:20:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-86f28ddd-768f-403f-8a30-47b42e4d53cf req-78da2619-c53b-4e26-b683-249edf26a77e service nova] [instance: 7b4dc389-1c65-4b86-827a-fc8d6bab644c] Received event network-vif-deleted-a6651aae-e6ab-4ed2-b317-61ce769e64b2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:20:56 user nova-compute[75621]: INFO nova.compute.claims [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Claim successful on node user
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.257s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:20:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:20:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:20:57 user nova-compute[75621]: INFO nova.virt.block_device [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Booting with volume 5c785d9e-c22a-4755-9f6d-c078df77372b at /dev/vda
Nov 27 23:20:57 user nova-compute[75621]: DEBUG nova.policy [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.utils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[570b0ead-5766-4745-af64-9f5aa6510843]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2876177-5123-4de8-9502-376c559ba33c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e44ad1-c0f6-468a-b309-ea089cb284dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c857e1-5265-4117-8162-48ad16a856bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:20:57 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:20:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f41a31e-f851-427f-9ba9-c1728ce78a8d]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG os_brick.utils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating existing volume attachment record: 36d6b6c8-b365-4b4b-a23e-39bb76bf9c49 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:20:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Successfully created port: bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Successfully updated port: bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-changed-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Refreshing instance network info cache due to event network-changed-bf2e416b-9558-4db6-b3c3-9f782af7a1e2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] Acquiring lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating instance_info_cache with network_info: [{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Instance network_info: |[{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] Acquired lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Refreshing network info cache for port bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:20:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updated VIF entry in instance network info cache for port bf2e416b-9558-4db6-b3c3-9f782af7a1e2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating instance_info_cache with network_info: [{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c23659ef-517a-42a2-a195-0d75e4d57151 req-8329b751-33b5-47bf-b296-2a63d5c4aff8 service nova] Releasing lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:20:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:21:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:21:03 user nova-compute[75621]: INFO nova.compute.claims [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Claim successful on node user
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:21:03 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG nova.policy [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '80b871115ca74f63af6dc4898e5cc991', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c299c8c8ab56464fabf11c255b22c2f0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:21:03 user nova-compute[75621]: INFO nova.virt.block_device [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Booting with volume 093592e0-0da3-4368-8c87-e6a937fad0cf at /dev/vda
Nov 27 23:21:03 user nova-compute[75621]: DEBUG os_brick.utils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdd4cac-34bb-4d4f-8aa0-eb1a7b91e599]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d104d2a4-6fdc-4df3-98d0-b6c2c10d23d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc738e10-b96e-4677-8603-c8d5017fbfd5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a03ae45-bb90-44c8-8b2a-4fa5b0c6e5f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:21:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:21:04 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1e26c-2f00-449e-9c73-a99200b26ade]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.utils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating existing volume attachment record: a022354b-55d8-41f1-a826-8f15a5162339 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:21:04 user nova-compute[75621]: INFO nova.compute.claims [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Claim successful on node user
Nov 27 23:21:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:21:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Creating image(s)
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Ensure instance console log exists: /opt/stack/data/nova/instances/6c37c104-1220-4672-a140-54a62f398b44/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Start _get_guest_xml network_info=[{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '36d6b6c8-b365-4b4b-a23e-39bb76bf9c49', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJKzWeOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c37c104-1220-4672-a140-54a62f398b44', 'attached_at': '', 'detached_at': '', 'volume_id': '5c785d9e-c22a-4755-9f6d-c078df77372b', 'serial': '5c785d9e-c22a-4755-9f6d-c078df77372b'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:21:04 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:04 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJKzWeOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:21:04 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:04 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:04 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95450e39-b45b-4dfb-b8b2-515e52167cdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:21:04 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28111ae-59cd-493a-ae22-90bafc3cc673]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b] added
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ed305-d1de-4c19-9c5a-703d0b08850d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acbaa1d-6235-439b-8d87-cf01052d74e7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJKzWeOE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pJKzWeOE" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e6c69e-b877-49e1-9353-32d5c1c29036]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pJKzWeOE'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca3db4f-90b8-4c1a-87af-5b5e50b40043]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9642a23f-cce0-45fe-aa7b-e39f8e8044b0]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Successfully created port: a767daef-0980-48e7-9665-303518745042 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbb37b9-f6cc-49b3-b1d2-fb3ab5714cd4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260]
Nov 27 23:21:04 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260] successful.
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d21b50-0d02-4adf-b62d-22565f67fad1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:21:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4be6f0-7720-42c0-9e3a-977c06a4bbfa]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:04 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:04 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:04 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6409489b-ee89-4e5e-92a6-7b73826fa128]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJKzWeOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:21:04 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Creating image(s)
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "/opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "/opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.policy [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c7f3a4fe69a492aab4db9062a6d838b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565ce700aeda4eb49c85cd697a9c0736', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk 1073741824" returned: 0 in 0.051s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Successfully updated port: a767daef-0980-48e7-9665-303518745042 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquired lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-changed-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Refreshing instance network info cache due to event network-changed-a767daef-0980-48e7-9665-303518745042. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] Acquiring lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Cannot resize image /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Ensure instance console log exists: /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23034343161363934', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034343161363934', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1844229631',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtotp/meKDGmOrDGQ+X6sKVoOZgYxMA/rsqg1NCexivnceNFQvD+sq9kbTkzApvIivwtJfqKoqBXIwK90zzw6L5EJAEJ25/9+vg5SjEKVoEx6Klh0ow4YzLXGQT8pJrxQ==',key_name='tempest-keypair-854960287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-z53wxd4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=6c37c104-1220-4672-a140-54a62f398b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c37c104-1220-4672-a140-54a62f398b44 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:21:05 user nova-compute[75621]:   <uuid>6c37c104-1220-4672-a140-54a62f398b44</uuid>
Nov 27 23:21:05 user nova-compute[75621]:   <name>instance-00000025</name>
Nov 27 23:21:05 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:21:05 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:21:05 user nova-compute[75621]:   <metadata>
Nov 27 23:21:05 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:21:05 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:21:05 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1844229631</nova:name>
Nov 27 23:21:05 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:21:04</nova:creationTime>
Nov 27 23:21:05 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:21:05 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:21:05 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:21:05 user nova-compute[75621]:       <nova:owner>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:21:05 user nova-compute[75621]:       </nova:owner>
Nov 27 23:21:05 user nova-compute[75621]:       <nova:ports>
Nov 27 23:21:05 user nova-compute[75621]:         <nova:port uuid="bf2e416b-9558-4db6-b3c3-9f782af7a1e2">
Nov 27 23:21:05 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 23:21:05 user nova-compute[75621]:         </nova:port>
Nov 27 23:21:05 user nova-compute[75621]:       </nova:ports>
Nov 27 23:21:05 user nova-compute[75621]:     </nova:instance>
Nov 27 23:21:05 user nova-compute[75621]:   </metadata>
Nov 27 23:21:05 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:21:05 user nova-compute[75621]:     <system>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="serial">6c37c104-1220-4672-a140-54a62f398b44</entry>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="uuid">6c37c104-1220-4672-a140-54a62f398b44</entry>
Nov 27 23:21:05 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:21:05 user nova-compute[75621]:     </system>
Nov 27 23:21:05 user nova-compute[75621]:   </sysinfo>
Nov 27 23:21:05 user nova-compute[75621]:   <os>
Nov 27 23:21:05 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:21:05 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:21:05 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:21:05 user nova-compute[75621]:   </os>
Nov 27 23:21:05 user nova-compute[75621]:   <features>
Nov 27 23:21:05 user nova-compute[75621]:     <acpi/>
Nov 27 23:21:05 user nova-compute[75621]:     <apic/>
Nov 27 23:21:05 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:21:05 user nova-compute[75621]:   </features>
Nov 27 23:21:05 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:21:05 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:21:05 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:21:05 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:21:05 user nova-compute[75621]:   </clock>
Nov 27 23:21:05 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:21:05 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:21:05 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:21:05 user nova-compute[75621]:   </cpu>
Nov 27 23:21:05 user nova-compute[75621]:   <devices>
Nov 27 23:21:05 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:21:05 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:21:05 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:21:05 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:21:05 user nova-compute[75621]:       <serial>5c785d9e-c22a-4755-9f6d-c078df77372b</serial>
Nov 27 23:21:05 user nova-compute[75621]:     </disk>
Nov 27 23:21:05 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:21:05 user nova-compute[75621]:       <mac address="fa:16:3e:86:33:56"/>
Nov 27 23:21:05 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:05 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:21:05 user nova-compute[75621]:       <target dev="tapbf2e416b-95"/>
Nov 27 23:21:05 user nova-compute[75621]:     </interface>
Nov 27 23:21:05 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:21:05 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/6c37c104-1220-4672-a140-54a62f398b44/console.log" append="off"/>
Nov 27 23:21:05 user nova-compute[75621]:     </serial>
Nov 27 23:21:05 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:21:05 user nova-compute[75621]:     <video>
Nov 27 23:21:05 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:05 user nova-compute[75621]:     </video>
Nov 27 23:21:05 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:21:05 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:21:05 user nova-compute[75621]:     </rng>
Nov 27 23:21:05 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:21:05 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:21:05 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:21:05 user nova-compute[75621]:     </memballoon>
Nov 27 23:21:05 user nova-compute[75621]:   </devices>
Nov 27 23:21:05 user nova-compute[75621]: </domain>
Nov 27 23:21:05 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1844229631',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtotp/meKDGmOrDGQ+X6sKVoOZgYxMA/rsqg1NCexivnceNFQvD+sq9kbTkzApvIivwtJfqKoqBXIwK90zzw6L5EJAEJ25/9+vg5SjEKVoEx6Klh0ow4YzLXGQT8pJrxQ==',key_name='tempest-keypair-854960287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-z53wxd4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:20:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=6c37c104-1220-4672-a140-54a62f398b44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG os_vif [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67511f77-9273-5d46-b793-0fc4d055b1bd', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf2e416b-95, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf2e416b-95, col_values=(('qos', UUID('59d1bf0f-b646-4ce1-830c-00e022035ed7')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf2e416b-95, col_values=(('external_ids', {'iface-id': 'bf2e416b-9558-4db6-b3c3-9f782af7a1e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:33:56', 'vm-uuid': '6c37c104-1220-4672-a140-54a62f398b44'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:05 user nova-compute[75621]: INFO os_vif [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95')
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:86:33:56, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating instance_info_cache with network_info: [{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Releasing lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance network_info: |[{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Successfully created port: 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] Acquired lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Refreshing network info cache for port a767daef-0980-48e7-9665-303518745042 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updated VIF entry in instance network info cache for port a767daef-0980-48e7-9665-303518745042. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating instance_info_cache with network_info: [{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b10b05a-8580-4e35-a711-5bee60581fe2 req-7dc0a00b-1713-4431-915c-632dae1d902c service nova] Releasing lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Successfully updated port: 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquired lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-changed-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Refreshing instance network info cache due to event network-changed-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] Acquiring lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updating instance_info_cache with network_info: [{"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Releasing lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Instance network_info: |[{"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] Acquired lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Refreshing network info cache for port 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Start _get_guest_xml network_info=[{"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:21:06 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:06 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:21:06 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360957302',display_name='tempest-AttachVolumeNegativeTest-server-360957302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360957302',id=39,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMllNU9jOjorjR8b1rlrWE7W+8zrhTd3vfSrgFr9BkVfWy2lM0HCcqasMtAKVXYkIB5wU4yP/BSeNFvMTVHDmPP4HksJWrxZARrIHCi05ox8cKF3T98ebyrzVEJavUjcEw==',key_name='tempest-keypair-1572840474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-102699j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'pci_devices' on Instance uuid 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:21:07 user nova-compute[75621]:   <uuid>6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80</uuid>
Nov 27 23:21:07 user nova-compute[75621]:   <name>instance-00000027</name>
Nov 27 23:21:07 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:21:07 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:21:07 user nova-compute[75621]:   <metadata>
Nov 27 23:21:07 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:21:07 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:name>tempest-AttachVolumeNegativeTest-server-360957302</nova:name>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:21:06</nova:creationTime>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:21:07 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:21:07 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:owner>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:user uuid="6c7f3a4fe69a492aab4db9062a6d838b">tempest-AttachVolumeNegativeTest-862898080-project-member</nova:user>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:project uuid="565ce700aeda4eb49c85cd697a9c0736">tempest-AttachVolumeNegativeTest-862898080</nova:project>
Nov 27 23:21:07 user nova-compute[75621]:       </nova:owner>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:21:07 user nova-compute[75621]:       <nova:ports>
Nov 27 23:21:07 user nova-compute[75621]:         <nova:port uuid="5ed9677c-988a-4f5f-9c7c-b4a7dc56017b">
Nov 27 23:21:07 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 23:21:07 user nova-compute[75621]:         </nova:port>
Nov 27 23:21:07 user nova-compute[75621]:       </nova:ports>
Nov 27 23:21:07 user nova-compute[75621]:     </nova:instance>
Nov 27 23:21:07 user nova-compute[75621]:   </metadata>
Nov 27 23:21:07 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:21:07 user nova-compute[75621]:     <system>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="serial">6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80</entry>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="uuid">6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80</entry>
Nov 27 23:21:07 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:21:07 user nova-compute[75621]:     </system>
Nov 27 23:21:07 user nova-compute[75621]:   </sysinfo>
Nov 27 23:21:07 user nova-compute[75621]:   <os>
Nov 27 23:21:07 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:21:07 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:21:07 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:21:07 user nova-compute[75621]:   </os>
Nov 27 23:21:07 user nova-compute[75621]:   <features>
Nov 27 23:21:07 user nova-compute[75621]:     <acpi/>
Nov 27 23:21:07 user nova-compute[75621]:     <apic/>
Nov 27 23:21:07 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:21:07 user nova-compute[75621]:   </features>
Nov 27 23:21:07 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:21:07 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:21:07 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:21:07 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:21:07 user nova-compute[75621]:   </clock>
Nov 27 23:21:07 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:21:07 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:21:07 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:21:07 user nova-compute[75621]:   </cpu>
Nov 27 23:21:07 user nova-compute[75621]:   <devices>
Nov 27 23:21:07 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:21:07 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:21:07 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk"/>
Nov 27 23:21:07 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:21:07 user nova-compute[75621]:     </disk>
Nov 27 23:21:07 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:21:07 user nova-compute[75621]:       <mac address="fa:16:3e:23:95:44"/>
Nov 27 23:21:07 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:07 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:21:07 user nova-compute[75621]:       <target dev="tap5ed9677c-98"/>
Nov 27 23:21:07 user nova-compute[75621]:     </interface>
Nov 27 23:21:07 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:21:07 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/console.log" append="off"/>
Nov 27 23:21:07 user nova-compute[75621]:     </serial>
Nov 27 23:21:07 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:21:07 user nova-compute[75621]:     <video>
Nov 27 23:21:07 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:07 user nova-compute[75621]:     </video>
Nov 27 23:21:07 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:21:07 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:21:07 user nova-compute[75621]:     </rng>
Nov 27 23:21:07 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:21:07 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:21:07 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:21:07 user nova-compute[75621]:     </memballoon>
Nov 27 23:21:07 user nova-compute[75621]:   </devices>
Nov 27 23:21:07 user nova-compute[75621]: </domain>
Nov 27 23:21:07 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360957302',display_name='tempest-AttachVolumeNegativeTest-server-360957302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360957302',id=39,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMllNU9jOjorjR8b1rlrWE7W+8zrhTd3vfSrgFr9BkVfWy2lM0HCcqasMtAKVXYkIB5wU4yP/BSeNFvMTVHDmPP4HksJWrxZARrIHCi05ox8cKF3T98ebyrzVEJavUjcEw==',key_name='tempest-keypair-1572840474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-102699j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:21:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG os_vif [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c896d2ad-415e-5b91-a263-6715f8e057b7', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ed9677c-98, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ed9677c-98, col_values=(('qos', UUID('607bda22-cea4-4ad2-b775-b30923273af6')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ed9677c-98, col_values=(('external_ids', {'iface-id': '5ed9677c-988a-4f5f-9c7c-b4a7dc56017b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:95:44', 'vm-uuid': '6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: INFO os_vif [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98')
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:23:95:44, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updated VIF entry in instance network info cache for port 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.network.neutron [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updating instance_info_cache with network_info: [{"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-002740e6-ae86-4979-8bb3-559faffcf540 req-9a57f379-138f-4d2f-80ba-ab14aa8c84ae service nova] Releasing lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] No waiting events found dispatching network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:07 user nova-compute[75621]: WARNING nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received unexpected event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 for instance with vm_state building and task_state spawning.
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] No waiting events found dispatching network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:07 user nova-compute[75621]: WARNING nova.compute.manager [req-fa253386-f802-4182-8a92-fa0f661aed93 req-9a0400da-6ce4-4afd-8097-26b22d8f0535 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received unexpected event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 for instance with vm_state building and task_state spawning.
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:07 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] No waiting events found dispatching network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:08 user nova-compute[75621]: WARNING nova.compute.manager [req-e48c2611-e071-497a-b197-686c369cf3a8 req-b7deba5a-6bda-414a-8190-d7a3c0020e88 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received unexpected event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b for instance with vm_state building and task_state spawning.
Nov 27 23:21:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:21:10 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Instance spawned successfully.
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:10 user nova-compute[75621]: INFO nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:10 user nova-compute[75621]: INFO nova.compute.manager [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Took 14.26 seconds to build instance.
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c5f826fc-3038-4e0d-b75f-ce0b600fa9f2 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.369s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:21:10 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Instance spawned successfully.
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] No waiting events found dispatching network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:10 user nova-compute[75621]: WARNING nova.compute.manager [req-6d9fef38-69d6-4e48-8bc3-b5f6c4b4875f req-397f6137-4042-4a9b-8b0d-9d8f0ebc7d93 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received unexpected event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b for instance with vm_state building and task_state spawning.
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: INFO nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:21:11 user nova-compute[75621]: INFO nova.compute.manager [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Took 6.99 seconds to build instance.
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-f7260724-4b69-40bb-86f7-df5925f4097d tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.090s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:21:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Creating image(s)
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Ensure instance console log exists: /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start _get_guest_xml network_info=[{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'a022354b-55d8-41f1-a826-8f15a5162339', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4462c3d9-f8e5-4c2c-aef9-6275d22d04e9', 'attached_at': '', 'detached_at': '', 'volume_id': '093592e0-0da3-4368-8c87-e6a937fad0cf', 'serial': '093592e0-0da3-4368-8c87-e6a937fad0cf'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:21:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8533MB free_disk=25.06845474243164GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:21:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:11 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e609ee3-7329-4244-89f4-7336cd5c2db1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:21:11 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[09222957-399d-4c20-a174-f2a79fa76be3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf] added
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6c37c104-1220-4672-a140-54a62f398b44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2992f-56e1-49bd-9b84-da146362742c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[672c0b15-d8ae-45cc-baf8-818c7dbdc223]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HscrXbOQ {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HscrXbOQ" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7413bd8-3ef0-4393-900c-99cdf7b68f8e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HscrXbOQ'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5acfae8-c673-4700-976b-039d9a04a713]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365755b-bbf1-4d59-9699-a2cf0495388c]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa3786-0fd0-4a2a-9649-13371dbf22c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]
Nov 27 23:21:11 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2788c31-cef4-4475-845e-52ca4b2fccb9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad01719-f060-4a85-a22f-a8092f34cc4b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:11 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1e6e74-117f-4c0b-b10b-c9b2a16bb9b7]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:21:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:21:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26664303365396130', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:21:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664303365396130', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215985664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lazy-loading 'pci_devices' on Instance uuid 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:21:13 user nova-compute[75621]:   <uuid>4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</uuid>
Nov 27 23:21:13 user nova-compute[75621]:   <name>instance-00000026</name>
Nov 27 23:21:13 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:21:13 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:21:13 user nova-compute[75621]:   <metadata>
Nov 27 23:21:13 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:21:13 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:21:13 user nova-compute[75621]:       <nova:name>tempest-ServerActionsV293TestJSON-server-215985664</nova:name>
Nov 27 23:21:13 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:21:11</nova:creationTime>
Nov 27 23:21:13 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:21:13 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:21:13 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:21:13 user nova-compute[75621]:       <nova:owner>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:user uuid="80b871115ca74f63af6dc4898e5cc991">tempest-ServerActionsV293TestJSON-1008450179-project-member</nova:user>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:project uuid="c299c8c8ab56464fabf11c255b22c2f0">tempest-ServerActionsV293TestJSON-1008450179</nova:project>
Nov 27 23:21:13 user nova-compute[75621]:       </nova:owner>
Nov 27 23:21:13 user nova-compute[75621]:       <nova:ports>
Nov 27 23:21:13 user nova-compute[75621]:         <nova:port uuid="a767daef-0980-48e7-9665-303518745042">
Nov 27 23:21:13 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:21:13 user nova-compute[75621]:         </nova:port>
Nov 27 23:21:13 user nova-compute[75621]:       </nova:ports>
Nov 27 23:21:13 user nova-compute[75621]:     </nova:instance>
Nov 27 23:21:13 user nova-compute[75621]:   </metadata>
Nov 27 23:21:13 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:21:13 user nova-compute[75621]:     <system>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="serial">4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</entry>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="uuid">4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</entry>
Nov 27 23:21:13 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:21:13 user nova-compute[75621]:     </system>
Nov 27 23:21:13 user nova-compute[75621]:   </sysinfo>
Nov 27 23:21:13 user nova-compute[75621]:   <os>
Nov 27 23:21:13 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:21:13 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:21:13 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:21:13 user nova-compute[75621]:   </os>
Nov 27 23:21:13 user nova-compute[75621]:   <features>
Nov 27 23:21:13 user nova-compute[75621]:     <acpi/>
Nov 27 23:21:13 user nova-compute[75621]:     <apic/>
Nov 27 23:21:13 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:21:13 user nova-compute[75621]:   </features>
Nov 27 23:21:13 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:21:13 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:21:13 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:21:13 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:21:13 user nova-compute[75621]:   </clock>
Nov 27 23:21:13 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:21:13 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:21:13 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:21:13 user nova-compute[75621]:   </cpu>
Nov 27 23:21:13 user nova-compute[75621]:   <devices>
Nov 27 23:21:13 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:21:13 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:21:13 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:21:13 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:21:13 user nova-compute[75621]:       <serial>093592e0-0da3-4368-8c87-e6a937fad0cf</serial>
Nov 27 23:21:13 user nova-compute[75621]:     </disk>
Nov 27 23:21:13 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:21:13 user nova-compute[75621]:       <mac address="fa:16:3e:40:73:32"/>
Nov 27 23:21:13 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:13 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:21:13 user nova-compute[75621]:       <target dev="tapa767daef-09"/>
Nov 27 23:21:13 user nova-compute[75621]:     </interface>
Nov 27 23:21:13 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:21:13 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9/console.log" append="off"/>
Nov 27 23:21:13 user nova-compute[75621]:     </serial>
Nov 27 23:21:13 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:21:13 user nova-compute[75621]:     <video>
Nov 27 23:21:13 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:13 user nova-compute[75621]:     </video>
Nov 27 23:21:13 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:21:13 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:21:13 user nova-compute[75621]:     </rng>
Nov 27 23:21:13 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:21:13 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:21:13 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:21:13 user nova-compute[75621]:     </memballoon>
Nov 27 23:21:13 user nova-compute[75621]:   </devices>
Nov 27 23:21:13 user nova-compute[75621]: </domain>
Nov 27 23:21:13 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-215985664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG os_vif [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f81adc54-1ca0-5424-bd47-4e0df276356f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa767daef-09, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa767daef-09, col_values=(('qos', UUID('733651de-b259-4805-8162-23c25bed0132')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa767daef-09, col_values=(('external_ids', {'iface-id': 'a767daef-0980-48e7-9665-303518745042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:73:32', 'vm-uuid': '4462c3d9-f8e5-4c2c-aef9-6275d22d04e9'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:13 user nova-compute[75621]: INFO os_vif [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09')
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] No VIF found with MAC fa:16:3e:40:73:32, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [{"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-8320d0ba-f01c-4d46-913f-2b125aaa759e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:14 user nova-compute[75621]: WARNING nova.compute.manager [req-1a689400-4e2b-4d72-9024-1d3db5f8f8d2 req-fec45b30-de5b-4b35-aff2-1badc7039654 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state building and task_state spawning.
Nov 27 23:21:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:16 user nova-compute[75621]: WARNING nova.compute.manager [req-b8b68655-9d28-4a19-bc2a-62295ea72a7c req-c3ec4383-67b5-4514-8bbe-0947d235b914 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state building and task_state spawning.
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:21:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance spawned successfully.
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:21:16 user nova-compute[75621]: INFO nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 27 23:21:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:21:16 user nova-compute[75621]: INFO nova.compute.manager [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Took 13.69 seconds to build instance.
Nov 27 23:21:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b38ad7c6-5163-41f8-a5cf-a191bf5a3ad9 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.798s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:27 user nova-compute[75621]: INFO nova.compute.manager [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Unshelving
Nov 27 23:21:27 user nova-compute[75621]: INFO nova.virt.block_device [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Booting with volume 8e88462c-611a-46f4-8273-b8c7cee5dc56 at /dev/vda
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.utils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[19484fa4-c70d-45f9-90f1-54db5462c7dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[69179a55-4fe1-40cd-9b1d-162ac352a9fb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[54274e15-ec1f-4da4-ad21-84b39fa4b9ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34041c9-35dd-4c3a-b6f2-25a1605f47ce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:21:27 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:21:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e293d14e-a84d-42dc-8280-364b92baccd0]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG os_brick.utils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:21:27 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating existing volume attachment record: 78203d78-be93-45fe-8cec-a51886b695b4 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:21:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'pci_requests' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'numa_topology' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:21:38 user nova-compute[75621]: INFO nova.compute.claims [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Claim successful on node user
Nov 27 23:21:38 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:21:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:38 user nova-compute[75621]: INFO nova.network.neutron [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating port 8a35be82-e44d-4e93-8d55-21c809b1daf7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing instance network info cache due to event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:21:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:21:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Creating image(s)
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Ensure instance console log exists: /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start _get_guest_xml network_info=[{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '78203d78-be93-45fe-8cec-a51886b695b4', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd10e0d60-288a-41e7-865f-01fe514ab7d8', 'attached_at': '', 'detached_at': '', 'volume_id': '8e88462c-611a-46f4-8273-b8c7cee5dc56', 'serial': '8e88462c-611a-46f4-8273-b8c7cee5dc56'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:21:40 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:40 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'vcpu_model' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.objects.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Object Instance<d10e0d60-288a-41e7-865f-01fe514ab7d8> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:21:40 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:40 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:21:40 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572cc70-5156-4333-a50b-6770bce9f581]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:21:40 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6c28e2-f916-4bbc-a7cb-e13c107e89fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56] added
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7f7cc1-6fd0-4630-b087-34d198fd9052]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e25af86-0e07-4009-9c51-6d9403aab233]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIvJYxjp {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CIvJYxjp" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ed5c77-deac-4d18-bd37-d6f3723d466e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CIvJYxjp'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f68da94-267d-45c4-80a2-00be01ee58c6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf6aac9-6918-4fb1-97a4-68606f58e22a]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d66446-0b3f-45b5-a563-90310e27f28a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]
Nov 27 23:21:40 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c5a0da-b1f7-4b35-a443-bb45a3f70ad1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[91322b2d-363d-49ce-89fa-612c5b30155b]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:21:40 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:21:40 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe5c78a-3fa9-4c48-bc47-11962e489dd0]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated VIF entry in instance network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:21:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-711c03e7-c8ba-44dd-a025-dc9d944a8e2c req-87677590-66d1-45b4-8fe1-7c112e6db0b7 service nova] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26234643939386431', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234643939386431', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1372082336',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:21:27Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'pci_devices' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.objects.base [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Object Instance<d10e0d60-288a-41e7-865f-01fe514ab7d8> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75621) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:21:41 user nova-compute[75621]:   <uuid>d10e0d60-288a-41e7-865f-01fe514ab7d8</uuid>
Nov 27 23:21:41 user nova-compute[75621]:   <name>instance-00000023</name>
Nov 27 23:21:41 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:21:41 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:21:41 user nova-compute[75621]:   <metadata>
Nov 27 23:21:41 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:21:41 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:21:41 user nova-compute[75621]:       <nova:name>tempest-TestShelveInstance-server-576060454</nova:name>
Nov 27 23:21:41 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:21:40</nova:creationTime>
Nov 27 23:21:41 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:21:41 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:21:41 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:21:41 user nova-compute[75621]:       <nova:owner>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:user uuid="f94d81e556a74a408cb5d1dd9ad11309">tempest-TestShelveInstance-864618270-project-member</nova:user>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:project uuid="67ff17a3fc094e00a80fd77a3f056b00">tempest-TestShelveInstance-864618270</nova:project>
Nov 27 23:21:41 user nova-compute[75621]:       </nova:owner>
Nov 27 23:21:41 user nova-compute[75621]:       <nova:ports>
Nov 27 23:21:41 user nova-compute[75621]:         <nova:port uuid="8a35be82-e44d-4e93-8d55-21c809b1daf7">
Nov 27 23:21:41 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:21:41 user nova-compute[75621]:         </nova:port>
Nov 27 23:21:41 user nova-compute[75621]:       </nova:ports>
Nov 27 23:21:41 user nova-compute[75621]:     </nova:instance>
Nov 27 23:21:41 user nova-compute[75621]:   </metadata>
Nov 27 23:21:41 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:21:41 user nova-compute[75621]:     <system>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="serial">d10e0d60-288a-41e7-865f-01fe514ab7d8</entry>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="uuid">d10e0d60-288a-41e7-865f-01fe514ab7d8</entry>
Nov 27 23:21:41 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:21:41 user nova-compute[75621]:     </system>
Nov 27 23:21:41 user nova-compute[75621]:   </sysinfo>
Nov 27 23:21:41 user nova-compute[75621]:   <os>
Nov 27 23:21:41 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:21:41 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:21:41 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:21:41 user nova-compute[75621]:   </os>
Nov 27 23:21:41 user nova-compute[75621]:   <features>
Nov 27 23:21:41 user nova-compute[75621]:     <acpi/>
Nov 27 23:21:41 user nova-compute[75621]:     <apic/>
Nov 27 23:21:41 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:21:41 user nova-compute[75621]:   </features>
Nov 27 23:21:41 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:21:41 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:21:41 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:21:41 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:21:41 user nova-compute[75621]:   </clock>
Nov 27 23:21:41 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:21:41 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:21:41 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:21:41 user nova-compute[75621]:   </cpu>
Nov 27 23:21:41 user nova-compute[75621]:   <devices>
Nov 27 23:21:41 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:21:41 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:21:41 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:21:41 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:21:41 user nova-compute[75621]:       <serial>8e88462c-611a-46f4-8273-b8c7cee5dc56</serial>
Nov 27 23:21:41 user nova-compute[75621]:     </disk>
Nov 27 23:21:41 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:21:41 user nova-compute[75621]:       <mac address="fa:16:3e:51:a2:7b"/>
Nov 27 23:21:41 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:41 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:21:41 user nova-compute[75621]:       <target dev="tap8a35be82-e4"/>
Nov 27 23:21:41 user nova-compute[75621]:     </interface>
Nov 27 23:21:41 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:21:41 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8/console.log" append="off"/>
Nov 27 23:21:41 user nova-compute[75621]:     </serial>
Nov 27 23:21:41 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:21:41 user nova-compute[75621]:     <video>
Nov 27 23:21:41 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:21:41 user nova-compute[75621]:     </video>
Nov 27 23:21:41 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:21:41 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:21:41 user nova-compute[75621]:     </rng>
Nov 27 23:21:41 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:21:41 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:21:41 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:21:41 user nova-compute[75621]:     </memballoon>
Nov 27 23:21:41 user nova-compute[75621]:   </devices>
Nov 27 23:21:41 user nova-compute[75621]: </domain>
Nov 27 23:21:41 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1372082336',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:17:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:21:27Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG os_vif [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '915456ad-e983-50c9-9b50-a5fe180f9ffe', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a35be82-e4, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a35be82-e4, col_values=(('qos', UUID('227aa8d7-89b5-4fb0-93d0-dfc36801762d')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a35be82-e4, col_values=(('external_ids', {'iface-id': '8a35be82-e44d-4e93-8d55-21c809b1daf7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:a2:7b', 'vm-uuid': 'd10e0d60-288a-41e7-865f-01fe514ab7d8'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:41 user nova-compute[75621]: INFO os_vif [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4')
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:21:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] No VIF found with MAC fa:16:3e:51:a2:7b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:43 user nova-compute[75621]: WARNING nova.compute.manager [req-0116f708-0b26-4722-a9ab-e4eb4b4fe18b req-7ae8ed87-8d84-4e98-a087-032952cd59a3 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:21:45 user nova-compute[75621]: WARNING nova.compute.manager [req-83351cfc-39ba-4062-a18d-216cf5993ac1 req-507a852f-2355-4800-b1d3-ce287dd4352c service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 27 23:21:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:21:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance spawned successfully.
Nov 27 23:21:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:21:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d176b5d0-10a4-4f0f-a559-c36581da1f51 tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.234s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:21:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:21:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:21:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:21:59 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:00 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:22:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:22:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:22:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8032MB free_disk=25.034481048583984GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6c37c104-1220-4672-a140-54a62f398b44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d10e0d60-288a-41e7-865f-01fe514ab7d8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:22:11 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:22:12 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:22:12 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:22:12 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:22:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.676s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:22:15 user nova-compute[75621]: INFO nova.compute.claims [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Claim successful on node user
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:22:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.policy [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8063d26e4982455497e74bf4234831c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225ed56580174c82872d16a37c20b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:22:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Creating image(s)
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "/opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "/opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:22:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Successfully created port: e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk 1073741824" returned: 0 in 0.059s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.257s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Cannot resize image /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Ensure instance console log exists: /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Successfully updated port: e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquired lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-changed-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Refreshing instance network info cache due to event network-changed-e1a7cdb7-e381-4288-8b88-9d5a357c375f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] Acquiring lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Updating instance_info_cache with network_info: [{"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Releasing lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Instance network_info: |[{"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] Acquired lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Refreshing network info cache for port e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Start _get_guest_xml network_info=[{"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:22:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:22:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-849995852',display_name='tempest-VolumesActionsTest-instance-849995852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-849995852',id=40,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-ln7k0jxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:22:16Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=2f29bb32-a98b-480c-a5fa-9dbec4a12df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.objects.instance [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f29bb32-a98b-480c-a5fa-9dbec4a12df2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:22:17 user nova-compute[75621]:   <uuid>2f29bb32-a98b-480c-a5fa-9dbec4a12df2</uuid>
Nov 27 23:22:17 user nova-compute[75621]:   <name>instance-00000028</name>
Nov 27 23:22:17 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:22:17 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:22:17 user nova-compute[75621]:   <metadata>
Nov 27 23:22:17 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:22:17 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:name>tempest-VolumesActionsTest-instance-849995852</nova:name>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:22:17</nova:creationTime>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:22:17 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:22:17 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:owner>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:user uuid="8063d26e4982455497e74bf4234831c3">tempest-VolumesActionsTest-89555776-project-member</nova:user>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:project uuid="225ed56580174c82872d16a37c20b84a">tempest-VolumesActionsTest-89555776</nova:project>
Nov 27 23:22:17 user nova-compute[75621]:       </nova:owner>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:22:17 user nova-compute[75621]:       <nova:ports>
Nov 27 23:22:17 user nova-compute[75621]:         <nova:port uuid="e1a7cdb7-e381-4288-8b88-9d5a357c375f">
Nov 27 23:22:17 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 23:22:17 user nova-compute[75621]:         </nova:port>
Nov 27 23:22:17 user nova-compute[75621]:       </nova:ports>
Nov 27 23:22:17 user nova-compute[75621]:     </nova:instance>
Nov 27 23:22:17 user nova-compute[75621]:   </metadata>
Nov 27 23:22:17 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:22:17 user nova-compute[75621]:     <system>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="serial">2f29bb32-a98b-480c-a5fa-9dbec4a12df2</entry>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="uuid">2f29bb32-a98b-480c-a5fa-9dbec4a12df2</entry>
Nov 27 23:22:17 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:22:17 user nova-compute[75621]:     </system>
Nov 27 23:22:17 user nova-compute[75621]:   </sysinfo>
Nov 27 23:22:17 user nova-compute[75621]:   <os>
Nov 27 23:22:17 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:22:17 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:22:17 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:22:17 user nova-compute[75621]:   </os>
Nov 27 23:22:17 user nova-compute[75621]:   <features>
Nov 27 23:22:17 user nova-compute[75621]:     <acpi/>
Nov 27 23:22:17 user nova-compute[75621]:     <apic/>
Nov 27 23:22:17 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:22:17 user nova-compute[75621]:   </features>
Nov 27 23:22:17 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:22:17 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:22:17 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:22:17 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:22:17 user nova-compute[75621]:   </clock>
Nov 27 23:22:17 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:22:17 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:22:17 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:22:17 user nova-compute[75621]:   </cpu>
Nov 27 23:22:17 user nova-compute[75621]:   <devices>
Nov 27 23:22:17 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:22:17 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:22:17 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk"/>
Nov 27 23:22:17 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:22:17 user nova-compute[75621]:     </disk>
Nov 27 23:22:17 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:22:17 user nova-compute[75621]:       <mac address="fa:16:3e:49:89:a4"/>
Nov 27 23:22:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:22:17 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:22:17 user nova-compute[75621]:       <target dev="tape1a7cdb7-e3"/>
Nov 27 23:22:17 user nova-compute[75621]:     </interface>
Nov 27 23:22:17 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:22:17 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/console.log" append="off"/>
Nov 27 23:22:17 user nova-compute[75621]:     </serial>
Nov 27 23:22:17 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:22:17 user nova-compute[75621]:     <video>
Nov 27 23:22:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:22:17 user nova-compute[75621]:     </video>
Nov 27 23:22:17 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:22:17 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:22:17 user nova-compute[75621]:     </rng>
Nov 27 23:22:17 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:22:17 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:22:17 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:22:17 user nova-compute[75621]:     </memballoon>
Nov 27 23:22:17 user nova-compute[75621]:   </devices>
Nov 27 23:22:17 user nova-compute[75621]: </domain>
Nov 27 23:22:17 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-849995852',display_name='tempest-VolumesActionsTest-instance-849995852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-849995852',id=40,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-ln7k0jxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:22:16Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=2f29bb32-a98b-480c-a5fa-9dbec4a12df2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG os_vif [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb729547-0e57-5281-8d9e-1db28d5826d2', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1a7cdb7-e3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1a7cdb7-e3, col_values=(('qos', UUID('a26c1f69-e4cb-43d8-9fcc-3a1fab6ff0a2')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1a7cdb7-e3, col_values=(('external_ids', {'iface-id': 'e1a7cdb7-e381-4288-8b88-9d5a357c375f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:89:a4', 'vm-uuid': '2f29bb32-a98b-480c-a5fa-9dbec4a12df2'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:17 user nova-compute[75621]: INFO os_vif [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3')
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] No VIF found with MAC fa:16:3e:49:89:a4, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Updated VIF entry in instance network info cache for port e1a7cdb7-e381-4288-8b88-9d5a357c375f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Updating instance_info_cache with network_info: [{"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c2c256a5-6f00-4586-867e-5c77220c2f13 req-aaf2c911-696a-4f8b-a113-303665e12e3c service nova] Releasing lock "refresh_cache-2f29bb32-a98b-480c-a5fa-9dbec4a12df2" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:22:19 user nova-compute[75621]: WARNING nova.compute.manager [req-0a454980-9c86-4498-ba06-1e35a65c7857 req-571e9074-0677-4701-8a25-937c29249ecd service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state building and task_state spawning.
Nov 27 23:22:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:22:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Instance spawned successfully.
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:22:21 user nova-compute[75621]: INFO nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 27 23:22:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:22:21 user nova-compute[75621]: INFO nova.compute.manager [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Took 6.08 seconds to build instance.
Nov 27 23:22:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-76a340d9-4517-45a9-9bce-15471c445c9e tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.249s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:22:21 user nova-compute[75621]: WARNING nova.compute.manager [req-07f3dab1-58d7-4c4d-bf21-eed8c58ccd79 req-82d00b55-e1dc-4d99-a119-a3e41f275245 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state active and task_state None.
Nov 27 23:22:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:22:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:30 user nova-compute[75621]: DEBUG nova.compute.manager [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing instance network info cache due to event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:31 user nova-compute[75621]: INFO nova.compute.manager [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Detaching volume b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:22:31 user nova-compute[75621]: INFO nova.virt.block_device [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Attempting to driver detach volume b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e from mountpoint /dev/vdb
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Attempting to detach device vdb from instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:22:31 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:22:31 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:22:31 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:22:31 user nova-compute[75621]:   <serial>b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e</serial>
Nov 27 23:22:31 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:22:31 user nova-compute[75621]: </disk>
Nov 27 23:22:31 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:22:31 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully detached device vdb from instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 from the persistent domain config.
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:22:31 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:22:31 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:22:31 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:22:31 user nova-compute[75621]:   <serial>b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e</serial>
Nov 27 23:22:31 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:22:31 user nova-compute[75621]: </disk>
Nov 27 23:22:31 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updated VIF entry in instance network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7461044d-5986-4892-8f31-512daa34126e req-ea60b8e2-c23b-487b-805a-b246ac37de54 service nova] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG nova.compute.manager [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing instance network info cache due to event network-changed-981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] Acquiring lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] Acquired lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Refreshing network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updated VIF entry in instance network info cache for port 981040bc-bd4a-4b8c-9444-d104e09cc3ed. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [{"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c60fe67e-f2b9-4651-956c-cd3413ff1130 req-54eef124-22b4-4f0d-a3d7-5e49cd2ed137 service nova] Releasing lock "refresh_cache-ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-changed-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Refreshing instance network info cache due to event network-changed-bf2e416b-9558-4db6-b3c3-9f782af7a1e2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] Acquiring lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] Acquired lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Refreshing network info cache for port bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updated VIF entry in instance network info cache for port bf2e416b-9558-4db6-b3c3-9f782af7a1e2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating instance_info_cache with network_info: [{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c0c1a0ae-52c8-4f7f-ac9e-f1d801620345 req-1e2dc642-3487-4477-9eeb-ee290699dfbe service nova] Releasing lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 is timed out.
Nov 27 23:22:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully detached device vdb from instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 from the live domain config.
Nov 27 23:22:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CsNkBXcE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:22:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d039d17a-bc4f-4955-bf11-5fc65a22747b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:22:51 user nova-compute[75621]: No targets found.
Nov 27 23:22:51 user nova-compute[75621]: iSNS:
Nov 27 23:22:51 user nova-compute[75621]: No targets found.
Nov 27 23:22:51 user nova-compute[75621]: STATIC:
Nov 27 23:22:51 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:22:51 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:51 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:51 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:22:51 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:51 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:51 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e
Nov 27 23:22:51 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:51 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:51 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf
Nov 27 23:22:51 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:51 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:51 user nova-compute[75621]: FIRMWARE:
Nov 27 23:22:51 user nova-compute[75621]: No targets found.
Nov 27 23:22:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:22:51 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:22:51 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[56010248-921a-440a-b270-4b0ae7189921]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f67a38-cdea-4759-b902-797b3063b2bc]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:22:51 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13004acf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ef90c-24ba-427c-8d3c-bc0b0e2c79a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9152fcc-7cb6-4d3e-b268-eae396ecbaba]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[447258aa-e66d-44e6-a577-876e27e4e79a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:22:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07f7fb8-0097-4497-acbe-ddb06619d626]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2352f053-1ec5-4be0-b1a9-1ea5b6f253a7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[62157078-afcf-48ad-af24-4055048b015a]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260]
Nov 27 23:22:52 user nova-compute[75621]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e, portal: 172.16.0.220,3260] successful.
Nov 27 23:22:52 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1a7f98c-c9f9-422d-8d88-29b8f0f28e8e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9108cd55-051f-441d-9bee-986e6af8f617]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] <== disconnect_volume: return (320ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'flavor' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-37e7a563-14c9-49c0-a25e-f3d3ac482afc tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.762s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-changed-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Refreshing instance network info cache due to event network-changed-a767daef-0980-48e7-9665-303518745042. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] Acquiring lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] Acquired lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG nova.network.neutron [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Refreshing network info cache for port a767daef-0980-48e7-9665-303518745042 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG nova.network.neutron [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updated VIF entry in instance network info cache for port a767daef-0980-48e7-9665-303518745042. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:54 user nova-compute[75621]: DEBUG nova.network.neutron [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating instance_info_cache with network_info: [{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-60c3cd2e-fadf-4289-a238-ee2daaa9ec6f req-189b60fd-d795-4efe-bcb1-4996811beeec service nova] Releasing lock "refresh_cache-4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:55 user nova-compute[75621]: INFO nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Rebuilding instance
Nov 27 23:22:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-changed-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Refreshing instance network info cache due to event network-changed-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Acquiring lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Acquired lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Refreshing network info cache for port 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance destroyed successfully.
Nov 27 23:22:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance destroyed successfully.
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-334831865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:22:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa767daef-09, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=733651de-b259-4805-8162-23c25bed0132) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:56 user nova-compute[75621]: INFO os_vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09')
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:22:56 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc664994-9a4a-4b02-ad2c-16550b9551c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:22:56 user nova-compute[75621]: No targets found.
Nov 27 23:22:56 user nova-compute[75621]: iSNS:
Nov 27 23:22:56 user nova-compute[75621]: No targets found.
Nov 27 23:22:56 user nova-compute[75621]: STATIC:
Nov 27 23:22:56 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:22:56 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:56 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:56 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:22:56 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:56 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:56 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf
Nov 27 23:22:56 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:56 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:56 user nova-compute[75621]: FIRMWARE:
Nov 27 23:22:56 user nova-compute[75621]: No targets found.
Nov 27 23:22:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:22:56 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:22:56 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f81b14-b852-442e-bb3d-1c4dbda9b599]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d468bf-0dd3-40c8-9dca-94158c96ca60]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:56 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:22:56 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:56 user nova-compute[75621]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:22:56 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05a0ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a4a4e8e-50f3-415a-b284-228b2792f127]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[188fcbf4-c661-40c7-a9a7-d7fe5599f7e2]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[efada237-0ae3-4b35-b3c6-92c777bde62f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d6641b-ecd2-4b49-a416-1bd575f97161]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.141s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f72c804-ac6a-4bf7-afae-2e05ab7b3543]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fc2051-e6c0-48d5-a117-94caccc38420]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]
Nov 27 23:22:56 user nova-compute[75621]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.
Nov 27 23:22:56 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updated VIF entry in instance network info cache for port 5ed9677c-988a-4f5f-9c7c-b4a7dc56017b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.network.neutron [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updating instance_info_cache with network_info: [{"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:22:56 user nova-compute[75621]: INFO nova.compute.claims [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Claim successful on node user
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Releasing lock "refresh_cache-6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:22:56 user nova-compute[75621]: WARNING nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state active and task_state rebuilding.
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:22:56 user nova-compute[75621]: WARNING nova.compute.manager [req-e9d849be-ec7f-43fb-bba4-51b4009a9c0b req-3c4a64ca-3464-4a6a-b6b5-1a0097752aba service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state active and task_state rebuilding.
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720d125-def1-48eb-a0af-6e9354d7765c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== disconnect_volume: return (451ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:22:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:22:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deleting instance files /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9_del
Nov 27 23:22:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deletion of /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9_del complete
Nov 27 23:22:57 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 could not be found.
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:22:57 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79524a97-d30f-4c72-b1d4-468fde18cc8e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:22:57 user nova-compute[75621]: No targets found.
Nov 27 23:22:57 user nova-compute[75621]: iSNS:
Nov 27 23:22:57 user nova-compute[75621]: No targets found.
Nov 27 23:22:57 user nova-compute[75621]: STATIC:
Nov 27 23:22:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:22:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:22:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:22:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:22:57 user nova-compute[75621]: FIRMWARE:
Nov 27 23:22:57 user nova-compute[75621]: No targets found.
Nov 27 23:22:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:22:57 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:22:57 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d538fe-f5a4-4fb9-92d6-f5a7735cb78b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff8b86a-27fb-438b-9d08-71c2ad4a1e97]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:57 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:22:57 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:22:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0687e20>, {}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Disconnecting from: [] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== disconnect_volume: return (80ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.515s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:22:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:22:57 user nova-compute[75621]: INFO nova.virt.block_device [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Booting with volume snapshot a0f5d6b5-842d-444b-97b7-a421747d1741 at /dev/vda
Nov 27 23:22:57 user nova-compute[75621]: DEBUG nova.policy [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:22:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Preparing to wait for external event volume-reimaged-093592e0-0da3-4368-8c87-e6a937fad0cf {{(pid=75621) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Successfully created port: 5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:22:58 user nova-compute[75621]: INFO nova.compute.manager [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Attaching volume bb073065-52ee-478c-bc71-1ca0359ee3fe to /dev/vdb
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.utils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[295bbbc1-56cd-4819-ba10-9a59d2a22f1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac19060-d89c-4158-8ba7-52aa45187e98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95213dc8-2f65-4f27-a14f-8a10318d6629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc32ac4-b986-4886-a5aa-0267cad98ad6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Successfully updated port: 5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:22:58 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d06395-f95b-42a8-ab6d-15be6d7fff5f]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG os_brick.utils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updating existing volume attachment record: b4d94aa0-7380-4ea4-b5d4-33cb63eb5cc8 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-changed-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Refreshing instance network info cache due to event network-changed-5ea1c23d-a361-4755-8078-bd9681acff17. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] Acquiring lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:22:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updating instance_info_cache with network_info: [{"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Instance network_info: |[{"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] Acquired lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Refreshing network info cache for port 5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:22:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updated VIF entry in instance network info cache for port 5ea1c23d-a361-4755-8078-bd9681acff17. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:23:00 user nova-compute[75621]: DEBUG nova.network.neutron [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updating instance_info_cache with network_info: [{"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9a83b593-e992-45aa-90a4-034a4622bfec req-e0b967b6-21a2-488b-afea-a9bc599141bc service nova] Releasing lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:23:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:23:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.utils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e350e4-cb74-42ae-b982-6c6441c0e50d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57af5702-8db2-426f-a154-fd25f5034fd2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c3c2e8-c6d3-4552-a999-e40840995a46]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feecfd0-3ce5-496a-9544-0f4527d0bdc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:23:03 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:23:03 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabe0be-c900-4c4d-ae59-e605bd772824]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG os_brick.utils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:03 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updating existing volume attachment record: bffc4e54-e9b8-4271-9b2a-898f8f504732 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:23:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:09 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:10 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:23:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Creating image(s)
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Ensure instance console log exists: /opt/stack/data/nova/instances/d69bddaf-9708-4d98-a10a-8f38a660abf0/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Start _get_guest_xml network_info=[{"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T23:22:49Z,direct_url=<?>,disk_format='qcow2',id=c1683c2f-cf52-4eef-b965-dbe641a012b9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-594001502',owner='4c394c68191644ed9f8a5e071b7b55dc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T23:22:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'bffc4e54-e9b8-4271-9b2a-898f8f504732', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBxDJKpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd69bddaf-9708-4d98-a10a-8f38a660abf0', 'attached_at': '', 'detached_at': '', 'volume_id': 'e54b191d-1a48-478e-876d-ea1e9f88e83e', 'serial': 'e54b191d-1a48-478e-876d-ea1e9f88e83e'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:23:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:11 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-27T23:22:49Z,direct_url=<?>,disk_format='qcow2',id=c1683c2f-cf52-4eef-b965-dbe641a012b9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-594001502',owner='4c394c68191644ed9f8a5e071b7b55dc',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-27T23:22:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBxDJKpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:11 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe530648-7e63-4309-bece-f59cf05e31a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:23:11 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877c424-4b6d-44df-8720-e2a7a8a587a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e] added
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac08063-705e-4dd3-9262-13625ed35b73]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[984ac74a-39a9-400a-8fd4-cc02e5c902c9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBxDJKpj {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uBxDJKpj" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f3093f-a4bf-4c9f-a795-66bc9ae681dc]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uBxDJKpj'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6a0149-515a-466d-a4f1-d2213ce30bcf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[448e184e-3d31-4070-8b08-375423eb82a0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7715b4-16c9-4947-9f05-c52a0a6649fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260]
Nov 27 23:23:11 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260] successful.
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[232e2e32-02b2-42f6-ae05-4009dface27c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ffb58-7997-45f8-87c9-5c41cfd895c0]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:11 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:11 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5289e34b-de8c-4e48-82ed-4d827fdb7111]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:11 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:23:11 user nova-compute[75621]: INFO nova.compute.claims [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Claim successful on node user
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBxDJKpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23535666363393037', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535666363393037', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-246167655',id=41,image_ref='c1683c2f-cf52-4eef-b965-dbe641a012b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATgyCA7/y5VfMtylbRpV2Aa0o8Zyoi7tQTR9XDoaztLa8BCAEygYwNKo4II2CxeQJHhRvEWkrxD74iJX7pa5xowQJLQtHMlZ8CU3nZNNcJsKSEgF81BoiYEw7yPsJpKow==',key_name='tempest-keypair-1612792955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-y1oz7mjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11911166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:22:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d69bddaf-9708-4d98-a10a-8f38a660abf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid d69bddaf-9708-4d98-a10a-8f38a660abf0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:23:12 user nova-compute[75621]:   <uuid>d69bddaf-9708-4d98-a10a-8f38a660abf0</uuid>
Nov 27 23:23:12 user nova-compute[75621]:   <name>instance-00000029</name>
Nov 27 23:23:12 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:23:12 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:23:12 user nova-compute[75621]:   <metadata>
Nov 27 23:23:12 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:23:12 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-246167655</nova:name>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:23:11</nova:creationTime>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:23:12 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:23:12 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:owner>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:23:12 user nova-compute[75621]:       </nova:owner>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:root type="image" uuid="c1683c2f-cf52-4eef-b965-dbe641a012b9"/>
Nov 27 23:23:12 user nova-compute[75621]:       <nova:ports>
Nov 27 23:23:12 user nova-compute[75621]:         <nova:port uuid="5ea1c23d-a361-4755-8078-bd9681acff17">
Nov 27 23:23:12 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 23:23:12 user nova-compute[75621]:         </nova:port>
Nov 27 23:23:12 user nova-compute[75621]:       </nova:ports>
Nov 27 23:23:12 user nova-compute[75621]:     </nova:instance>
Nov 27 23:23:12 user nova-compute[75621]:   </metadata>
Nov 27 23:23:12 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:23:12 user nova-compute[75621]:     <system>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="serial">d69bddaf-9708-4d98-a10a-8f38a660abf0</entry>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="uuid">d69bddaf-9708-4d98-a10a-8f38a660abf0</entry>
Nov 27 23:23:12 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:23:12 user nova-compute[75621]:     </system>
Nov 27 23:23:12 user nova-compute[75621]:   </sysinfo>
Nov 27 23:23:12 user nova-compute[75621]:   <os>
Nov 27 23:23:12 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:23:12 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:23:12 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:23:12 user nova-compute[75621]:   </os>
Nov 27 23:23:12 user nova-compute[75621]:   <features>
Nov 27 23:23:12 user nova-compute[75621]:     <acpi/>
Nov 27 23:23:12 user nova-compute[75621]:     <apic/>
Nov 27 23:23:12 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:23:12 user nova-compute[75621]:   </features>
Nov 27 23:23:12 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:23:12 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:23:12 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:23:12 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:23:12 user nova-compute[75621]:   </clock>
Nov 27 23:23:12 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:23:12 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:23:12 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:23:12 user nova-compute[75621]:   </cpu>
Nov 27 23:23:12 user nova-compute[75621]:   <devices>
Nov 27 23:23:12 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:23:12 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:23:12 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:23:12 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:23:12 user nova-compute[75621]:       <serial>e54b191d-1a48-478e-876d-ea1e9f88e83e</serial>
Nov 27 23:23:12 user nova-compute[75621]:     </disk>
Nov 27 23:23:12 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:23:12 user nova-compute[75621]:       <mac address="fa:16:3e:d0:b3:b3"/>
Nov 27 23:23:12 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:12 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:23:12 user nova-compute[75621]:       <target dev="tap5ea1c23d-a3"/>
Nov 27 23:23:12 user nova-compute[75621]:     </interface>
Nov 27 23:23:12 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:23:12 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/d69bddaf-9708-4d98-a10a-8f38a660abf0/console.log" append="off"/>
Nov 27 23:23:12 user nova-compute[75621]:     </serial>
Nov 27 23:23:12 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:23:12 user nova-compute[75621]:     <video>
Nov 27 23:23:12 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:12 user nova-compute[75621]:     </video>
Nov 27 23:23:12 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:23:12 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:23:12 user nova-compute[75621]:     </rng>
Nov 27 23:23:12 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:23:12 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:23:12 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:23:12 user nova-compute[75621]:     </memballoon>
Nov 27 23:23:12 user nova-compute[75621]:   </devices>
Nov 27 23:23:12 user nova-compute[75621]: </domain>
Nov 27 23:23:12 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-246167655',id=41,image_ref='c1683c2f-cf52-4eef-b965-dbe641a012b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATgyCA7/y5VfMtylbRpV2Aa0o8Zyoi7tQTR9XDoaztLa8BCAEygYwNKo4II2CxeQJHhRvEWkrxD74iJX7pa5xowQJLQtHMlZ8CU3nZNNcJsKSEgF81BoiYEw7yPsJpKow==',key_name='tempest-keypair-1612792955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-y1oz7mjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11911166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:22:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d69bddaf-9708-4d98-a10a-8f38a660abf0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG os_vif [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8393a70b-2263-5512-b972-7de44c2b5dee', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea1c23d-a3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ea1c23d-a3, col_values=(('qos', UUID('a2bd16dc-8d64-496a-adcb-4953f19e5413')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ea1c23d-a3, col_values=(('external_ids', {'iface-id': '5ea1c23d-a361-4755-8078-bd9681acff17', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:b3:b3', 'vm-uuid': 'd69bddaf-9708-4d98-a10a-8f38a660abf0'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:12 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:23:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:12 user nova-compute[75621]: INFO os_vif [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3')
Nov 27 23:23:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.policy [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '626e3f11835549ee9a3765319d7fe55b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a6b701eedff4276b638269324422bc3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:23:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8074MB free_disk=24.993213653564453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:d0:b3:b3, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:23:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Creating image(s)
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "/opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "/opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdjTyfEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:13 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:13 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:13 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2074d6c2-dbeb-4408-8cac-f27d25f2b57e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:23:13 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[41df5f06-a737-4105-9b54-f8e69a1e4f10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe] added
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6c37c104-1220-4672-a140-54a62f398b44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d10e0d60-288a-41e7-865f-01fe514ab7d8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 2f29bb32-a98b-480c-a5fa-9dbec4a12df2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d69bddaf-9708-4d98-a10a-8f38a660abf0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8e45e11-3732-4bf0-959e-79963cf8ac3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8bfe51-6f34-4309-af18-1ef4e73daef2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[209f4e07-580b-4d6d-83e8-fdbf45661265]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdjTyfEL {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UdjTyfEL" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d770fd-d534-40b6-811d-0f857b1aa5c0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UdjTyfEL'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ab867-55ac-4943-9f7f-4812aae9923e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a2dcc4-c15b-4f14-b9e8-9c8fb49ec86b]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.200s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2438f86-66b8-4612-9221-37afad34d33c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260]
Nov 27 23:23:13 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260] successful.
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e855293a-1c26-48a1-98e9-5364a0e8a418]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d15f2b-b8ba-467c-a2ff-d7a1523fdea3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:13 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] HCTL ('37', '-', '-', 0) found on session 50 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[748ec630-0df7-47f6-9c88-b62b1b55f63e]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Searching for a device in session 50 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdjTyfEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Successfully created port: 120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.208s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.749s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Cannot resize image /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Ensure instance console log exists: /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Successfully updated port: 120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquired lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-changed-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Refreshing instance network info cache due to event network-changed-120638fa-e253-4877-b65a-4d918b0a7e3a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] Acquiring lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.compute.manager [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] No waiting events found dispatching network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:14 user nova-compute[75621]: WARNING nova.compute.manager [req-56a9f157-97bd-4f9b-bcfa-0e694d300785 req-3f54bbcd-1cee-4894-8599-704fe88c04bb service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received unexpected event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 for instance with vm_state building and task_state spawning.
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.neutron [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating instance_info_cache with network_info: [{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Releasing lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Instance network_info: |[{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] Acquired lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.neutron [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Refreshing network info cache for port 120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Start _get_guest_xml network_info=[{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.529s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '26361636662343338', 'path': '/dev/sdf'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361636662343338', 'path': '/dev/sdf'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.objects.instance [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1914719192',display_name='tempest-TestServerVolumeAttachmentScenario-server-1914719192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1914719192',id=42,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN9VmsWsPc8tEEoiX5ILBFSVIXkSwElHaX4yxWAZpqZ4Yra7uPZiEACgKnyOb9g2eA2aHKBZZq5Hnf6bkJtUAutJCAyeIy7yJs5w2tNjEqcYFbjtutpIRJcOB8iFY8MtA==',key_name='tempest-keypair-1309957419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b701eedff4276b638269324422bc3',ramdisk_id='',reservation_id='r-pp05ewmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1147127762',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1147127762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='626e3f11835549ee9a3765319d7fe55b',uuid=b8e45e11-3732-4bf0-959e-79963cf8ac3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converting VIF {"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.objects.instance [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'pci_devices' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:23:14 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:23:14 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:23:14 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:23:14 user nova-compute[75621]:   <serial>bb073065-52ee-478c-bc71-1ca0359ee3fe</serial>
Nov 27 23:23:14 user nova-compute[75621]: </disk>
Nov 27 23:23:14 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:23:14 user nova-compute[75621]:   <uuid>b8e45e11-3732-4bf0-959e-79963cf8ac3a</uuid>
Nov 27 23:23:14 user nova-compute[75621]:   <name>instance-0000002a</name>
Nov 27 23:23:14 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:23:14 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:23:14 user nova-compute[75621]:   <metadata>
Nov 27 23:23:14 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:23:14 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1914719192</nova:name>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:23:14</nova:creationTime>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:23:14 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:23:14 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:owner>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:user uuid="626e3f11835549ee9a3765319d7fe55b">tempest-TestServerVolumeAttachmentScenario-1147127762-project-member</nova:user>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:project uuid="6a6b701eedff4276b638269324422bc3">tempest-TestServerVolumeAttachmentScenario-1147127762</nova:project>
Nov 27 23:23:14 user nova-compute[75621]:       </nova:owner>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:23:14 user nova-compute[75621]:       <nova:ports>
Nov 27 23:23:14 user nova-compute[75621]:         <nova:port uuid="120638fa-e253-4877-b65a-4d918b0a7e3a">
Nov 27 23:23:14 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:23:14 user nova-compute[75621]:         </nova:port>
Nov 27 23:23:14 user nova-compute[75621]:       </nova:ports>
Nov 27 23:23:14 user nova-compute[75621]:     </nova:instance>
Nov 27 23:23:14 user nova-compute[75621]:   </metadata>
Nov 27 23:23:14 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:23:14 user nova-compute[75621]:     <system>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="serial">b8e45e11-3732-4bf0-959e-79963cf8ac3a</entry>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="uuid">b8e45e11-3732-4bf0-959e-79963cf8ac3a</entry>
Nov 27 23:23:14 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:23:14 user nova-compute[75621]:     </system>
Nov 27 23:23:14 user nova-compute[75621]:   </sysinfo>
Nov 27 23:23:14 user nova-compute[75621]:   <os>
Nov 27 23:23:14 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:23:14 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:23:14 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:23:14 user nova-compute[75621]:   </os>
Nov 27 23:23:14 user nova-compute[75621]:   <features>
Nov 27 23:23:14 user nova-compute[75621]:     <acpi/>
Nov 27 23:23:14 user nova-compute[75621]:     <apic/>
Nov 27 23:23:14 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:23:14 user nova-compute[75621]:   </features>
Nov 27 23:23:14 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:23:14 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:23:14 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:23:14 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:23:14 user nova-compute[75621]:   </clock>
Nov 27 23:23:14 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:23:14 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:23:14 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:23:14 user nova-compute[75621]:   </cpu>
Nov 27 23:23:14 user nova-compute[75621]:   <devices>
Nov 27 23:23:14 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:23:14 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:23:14 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk"/>
Nov 27 23:23:14 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:23:14 user nova-compute[75621]:     </disk>
Nov 27 23:23:14 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:23:14 user nova-compute[75621]:       <mac address="fa:16:3e:e6:60:a3"/>
Nov 27 23:23:14 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:14 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:23:14 user nova-compute[75621]:       <target dev="tap120638fa-e2"/>
Nov 27 23:23:14 user nova-compute[75621]:     </interface>
Nov 27 23:23:14 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:23:14 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/console.log" append="off"/>
Nov 27 23:23:14 user nova-compute[75621]:     </serial>
Nov 27 23:23:14 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:23:14 user nova-compute[75621]:     <video>
Nov 27 23:23:14 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:14 user nova-compute[75621]:     </video>
Nov 27 23:23:14 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:23:14 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:23:14 user nova-compute[75621]:     </rng>
Nov 27 23:23:14 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:23:14 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:23:14 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:23:14 user nova-compute[75621]:     </memballoon>
Nov 27 23:23:14 user nova-compute[75621]:   </devices>
Nov 27 23:23:14 user nova-compute[75621]: </domain>
Nov 27 23:23:14 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1914719192',display_name='tempest-TestServerVolumeAttachmentScenario-server-1914719192',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1914719192',id=42,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN9VmsWsPc8tEEoiX5ILBFSVIXkSwElHaX4yxWAZpqZ4Yra7uPZiEACgKnyOb9g2eA2aHKBZZq5Hnf6bkJtUAutJCAyeIy7yJs5w2tNjEqcYFbjtutpIRJcOB8iFY8MtA==',key_name='tempest-keypair-1309957419',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a6b701eedff4276b638269324422bc3',ramdisk_id='',reservation_id='r-pp05ewmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1147127762',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1147127762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:23:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='626e3f11835549ee9a3765319d7fe55b',uuid=b8e45e11-3732-4bf0-959e-79963cf8ac3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converting VIF {"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG os_vif [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ab3c25c-1b1b-5fa0-bb56-2daee16815c0', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap120638fa-e2, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap120638fa-e2, col_values=(('qos', UUID('6b097286-b985-4f79-8087-fadd14b8b0f1')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap120638fa-e2, col_values=(('external_ids', {'iface-id': '120638fa-e253-4877-b65a-4d918b0a7e3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:60:a3', 'vm-uuid': 'b8e45e11-3732-4bf0-959e-79963cf8ac3a'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:14 user nova-compute[75621]: INFO os_vif [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2')
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:23:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No VIF found with MAC fa:16:3e:e6:60:a3, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG nova.network.neutron [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updated VIF entry in instance network info cache for port 120638fa-e253-4877-b65a-4d918b0a7e3a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG nova.network.neutron [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating instance_info_cache with network_info: [{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-09826e7b-be67-4849-8d3b-4e054ae01d1d req-b204b2c7-badb-4e85-b32f-8adafe9415bd service nova] Releasing lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] No VIF found with MAC fa:16:3e:23:95:44, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:23:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-2a7c6c09-8b89-48f7-928f-db184bab3954 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.780s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.compute.manager [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Detaching volume bb073065-52ee-478c-bc71-1ca0359ee3fe
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Instance spawned successfully.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] No waiting events found dispatching network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:16 user nova-compute[75621]: WARNING nova.compute.manager [req-7d229dca-97dd-4ff9-91e6-81d611f1cbd0 req-9e4f19dd-a30d-4ff8-a6f8-f35629cc7816 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received unexpected event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 for instance with vm_state building and task_state spawning.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.virt.block_device [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Attempting to driver detach volume bb073065-52ee-478c-bc71-1ca0359ee3fe from mountpoint /dev/vdb
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] No waiting events found dispatching network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:16 user nova-compute[75621]: WARNING nova.compute.manager [req-02c7cad0-4ea4-4ed7-b447-c4bed77767e1 req-896eb6c9-1805-4d77-8104-201ca8bf2ccd service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received unexpected event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a for instance with vm_state building and task_state spawning.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Attempting to detach device vdb from instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:23:16 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:23:16 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:23:16 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:23:16 user nova-compute[75621]:   <serial>bb073065-52ee-478c-bc71-1ca0359ee3fe</serial>
Nov 27 23:23:16 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:23:16 user nova-compute[75621]: </disk>
Nov 27 23:23:16 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 from the persistent domain config.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:23:16 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:23:16 user nova-compute[75621]:   <source dev="/dev/sdf"/>
Nov 27 23:23:16 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:23:16 user nova-compute[75621]:   <serial>bb073065-52ee-478c-bc71-1ca0359ee3fe</serial>
Nov 27 23:23:16 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:23:16 user nova-compute[75621]: </disk>
Nov 27 23:23:16 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:23:16 user nova-compute[75621]: INFO nova.compute.manager [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Took 20.08 seconds to build instance.
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:23:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5e38a561-5bc5-47f7-8cca-f89f7cd77946 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.512s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:23:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:18 user nova-compute[75621]: INFO nova.compute.manager [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Terminating instance
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] No waiting events found dispatching network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:18 user nova-compute[75621]: WARNING nova.compute.manager [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received unexpected event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a for instance with vm_state building and task_state spawning.
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing instance network info cache due to event network-changed-8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Acquiring lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Acquired lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Refreshing network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:23:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Instance spawned successfully.
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:19 user nova-compute[75621]: INFO nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updated VIF entry in instance network info cache for port 8a35be82-e44d-4e93-8d55-21c809b1daf7. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [{"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3b0b7d28-58eb-47c6-bea4-810f78853122 req-1a54bc2b-a5ff-4f39-b9b7-8098205d9aa6 service nova] Releasing lock "refresh_cache-d10e0d60-288a-41e7-865f-01fe514ab7d8" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: INFO nova.compute.manager [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Took 7.45 seconds to build instance.
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-51e2700f-e673-4579-9c6a-bfdc46022cf4 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.604s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Instance destroyed successfully.
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lazy-loading 'resources' on Instance uuid d10e0d60-288a-41e7-865f-01fe514ab7d8 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-576060454',display_name='tempest-TestShelveInstance-server-576060454',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-576060454',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXTS2BjNbZ3FT+r/pITUL+bItthGa8a0JmXE47UIE8ULsb1xEhgqmNpq+j+DaQaCLAelEiOnnqJB2Bgu6wk+e5tW8MxxbbyzaEb6/fjTvqTMoNhayjZDF7xi8ufTvwgHw==',key_name='tempest-TestShelveInstance-1372082336',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='67ff17a3fc094e00a80fd77a3f056b00',ramdisk_id='',reservation_id='r-lec53a9n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-864618270',owner_user_name='tempest-TestShelveInstance-864618270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:21:46Z,user_data=None,user_id='f94d81e556a74a408cb5d1dd9ad11309',uuid=d10e0d60-288a-41e7-865f-01fe514ab7d8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converting VIF {"id": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "address": "fa:16:3e:51:a2:7b", "network": {"id": "c7529af0-0cab-48a7-a58f-d1630c8b46cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-399082566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "67ff17a3fc094e00a80fd77a3f056b00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a35be82-e4", "ovs_interfaceid": "8a35be82-e44d-4e93-8d55-21c809b1daf7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_vif [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a35be82-e4, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=227aa8d7-89b5-4fb0-93d0-dfc36801762d) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:19 user nova-compute[75621]: INFO os_vif [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:a2:7b,bridge_name='br-int',has_traffic_filtering=True,id=8a35be82-e44d-4e93-8d55-21c809b1daf7,network=Network(c7529af0-0cab-48a7-a58f-d1630c8b46cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a35be82-e4')
Nov 27 23:23:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CIvJYxjp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:19 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[339edb5b-7778-47b8-87a2-1a70fed79986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:23:19 user nova-compute[75621]: No targets found.
Nov 27 23:23:19 user nova-compute[75621]: iSNS:
Nov 27 23:23:19 user nova-compute[75621]: No targets found.
Nov 27 23:23:19 user nova-compute[75621]: STATIC:
Nov 27 23:23:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe
Nov 27 23:23:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:23:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e
Nov 27 23:23:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56
Nov 27 23:23:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf
Nov 27 23:23:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:19 user nova-compute[75621]: FIRMWARE:
Nov 27 23:23:19 user nova-compute[75621]: No targets found.
Nov 27 23:23:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:23:19 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:23:19 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edc547-2d85-4210-8218-e1fed4d34392]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[043b411a-042e-4f91-b0c0-517daf9d95bd]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:19 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0432ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d489351e-1506-4e27-8938-39891dfddfaa]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55224db2-ee41-4a1c-8adc-2069f6ad9500]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b420c3-e22e-48a6-b39e-d7cb3ee0f2f9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.165s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7915fea-0b56-4c1f-a096-52032d2fb81a]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26234643939386431', '/dev/disk/by-id/scsi-1SCST_BIOc047431e-b4d998d1e86c6792', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c047431e') {{(pid=86804) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6050a1e9-fcf0-4782-a30b-b94b20d1e0d8]: (4, None) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9ec80c-a88d-4331-a83b-e029289bbbbf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.213s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b5a19c-4756-4181-814d-ce2e7061c231]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260]
Nov 27 23:23:20 user nova-compute[75621]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56, portal: 172.16.0.220,3260] successful.
Nov 27 23:23:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e88462c-611a-46f4-8273-b8c7cee5dc56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b14308-4825-4d63-b411-d4f960c2d982]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.655s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] <== disconnect_volume: return (656ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:23:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deleting instance files /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8_del
Nov 27 23:23:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deletion of /opt/stack/data/nova/instances/d10e0d60-288a-41e7-865f-01fe514ab7d8_del complete
Nov 27 23:23:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:20 user nova-compute[75621]: INFO nova.compute.manager [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-unplugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Acquiring lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] No waiting events found dispatching network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:20 user nova-compute[75621]: WARNING nova.compute.manager [req-9999351d-9ef9-49b3-9f7f-936a3f9eed51 req-138772b4-01ab-45c2-be4b-6f8c3a123b52 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received unexpected event network-vif-plugged-8a35be82-e44d-4e93-8d55-21c809b1daf7 for instance with vm_state active and task_state deleting.
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:20 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Took 0.56 seconds to deallocate network for instance.
Nov 27 23:23:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-82c8049a-0906-4478-be4f-1291cb13ec86 req-98bddbe4-6730-4980-973f-4dc16e069768 service nova] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Received event network-vif-deleted-8a35be82-e44d-4e93-8d55-21c809b1daf7 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:21 user nova-compute[75621]: INFO nova.compute.manager [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Terminating instance
Nov 27 23:23:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Instance destroyed successfully.
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.objects.instance [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid ec98e368-8ca4-45ce-8e68-4e49bc3a6f69 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1787616905',display_name='tempest-ServerRescueNegativeTestJSON-server-1787616905',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1787616905',id=33,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAS0ZwCHXZAnAR6OYHa6naOHeK2boGFA0IKffVC80SngxVY1SyQMcK2omJDuPeINGk2K/mtCUlyxFnPRUx6wJ8EC9epWvHYo0YwlCOb83aw4u90rQ7Q4PnW+SBU0DAipng==',key_name='tempest-keypair-950122851',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:18:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-6guz2f5j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=ec98e368-8ca4-45ce-8e68-4e49bc3a6f69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "address": "fa:16:3e:12:23:98", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap981040bc-bd", "ovs_interfaceid": "981040bc-bd4a-4b8c-9444-d104e09cc3ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG os_vif [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap981040bc-bd, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=853348f6-1d42-4113-838b-bd94297a1f45) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:22 user nova-compute[75621]: INFO os_vif [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:12:23:98,bridge_name='br-int',has_traffic_filtering=True,id=981040bc-bd4a-4b8c-9444-d104e09cc3ed,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap981040bc-bd')
Nov 27 23:23:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Deleting instance files /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69_del
Nov 27 23:23:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Deletion of /opt/stack/data/nova/instances/ec98e368-8ca4-45ce-8e68-4e49bc3a6f69_del complete
Nov 27 23:23:22 user nova-compute[75621]: INFO nova.compute.manager [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:23:22 user nova-compute[75621]: INFO nova.compute.manager [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Took 1.79 seconds to detach 1 volumes for instance.
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] [instance: d10e0d60-288a-41e7-865f-01fe514ab7d8] Deleting volume: 8e88462c-611a-46f4-8273-b8c7cee5dc56 {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-unplugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Acquiring lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] No waiting events found dispatching network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:22 user nova-compute[75621]: WARNING nova.compute.manager [req-f582f173-f092-4cf5-a242-60aba7220bc1 req-73975913-f28b-429e-94b0-e120f8a40538 service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received unexpected event network-vif-plugged-981040bc-bd4a-4b8c-9444-d104e09cc3ed for instance with vm_state active and task_state deleting.
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:23 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Deleted allocations for instance d10e0d60-288a-41e7-865f-01fe514ab7d8
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:23:23 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Took 0.78 seconds to deallocate network for instance.
Nov 27 23:23:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ff5adce0-e532-4c6c-9da6-984407aa644b tempest-TestShelveInstance-864618270 tempest-TestShelveInstance-864618270-project-member] Lock "d10e0d60-288a-41e7-865f-01fe514ab7d8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.848s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-dfb70aa4-e364-459b-87ed-9fd53944013a req-cc749d22-509b-489f-a399-9c74f69e112a service nova] [instance: ec98e368-8ca4-45ce-8e68-4e49bc3a6f69] Received event network-vif-deleted-981040bc-bd4a-4b8c-9444-d104e09cc3ed {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:23:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:23 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Deleted allocations for instance ec98e368-8ca4-45ce-8e68-4e49bc3a6f69
Nov 27 23:23:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-eea530e0-5aae-48da-9de5-68471152fdce tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "ec98e368-8ca4-45ce-8e68-4e49bc3a6f69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 req-5c67b53d-5359-41f6-a94b-96638917deef service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event volume-reimaged-093592e0-0da3-4368-8c87-e6a937fad0cf {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 req-5c67b53d-5359-41f6-a94b-96638917deef service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 req-5c67b53d-5359-41f6-a94b-96638917deef service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 req-5c67b53d-5359-41f6-a94b-96638917deef service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG nova.compute.manager [req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 req-5c67b53d-5359-41f6-a94b-96638917deef service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Processing event volume-reimaged-093592e0-0da3-4368-8c87-e6a937fad0cf {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 27 23:23:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance event wait completed in 27 seconds for volume-reimaged {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:23:26 user nova-compute[75621]: INFO nova.virt.block_device [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Booting with volume 093592e0-0da3-4368-8c87-e6a937fad0cf at /dev/vda
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f61a0e7-a8ba-40ff-97f8-713511063e6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b73d790-a5d1-47f6-accb-69e0908f7575]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0ae54-4628-4568-a1e3-426f68cbeb92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec913fa-aa7e-44bd-9067-dd0044402e2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:23:26 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:23:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4cc22f-2f68-4410-b7cc-b9b16e0f36de]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:26 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating existing volume attachment record: e157c654-7123-4950-b417-510de2129381 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:23:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:23:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Creating image(s)
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Ensure instance console log exists: /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start _get_guest_xml network_info=[{"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e157c654-7123-4950-b417-510de2129381', 'delete_on_termination': True, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4462c3d9-f8e5-4c2c-aef9-6275d22d04e9', 'attached_at': '', 'detached_at': '', 'volume_id': '093592e0-0da3-4368-8c87-e6a937fad0cf', 'serial': '093592e0-0da3-4368-8c87-e6a937fad0cf'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:23:34 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 23:23:34 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:34 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:34 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:34 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2d7634-a65c-4007-bc07-cabc4988ea41]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:23:34 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc3301f-7ea3-455f-8ed0-31a5b3c362e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf] added
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbd6969-4b1e-4177-b0bb-115c2271fc41]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3265f869-157c-4619-9c86-221267bd4860]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HscrXbOQ {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HscrXbOQ" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bbf17-8d4c-4790-ab7a-aba667c7845f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HscrXbOQ'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c42121c-7dce-43c0-b319-e10e418c5795]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f5b2dc-7df9-4e55-b2fa-9f82f7f82a63]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4575438b-1c8d-4220-b875-ab15dec79869]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]
Nov 27 23:23:34 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd266d7-a81b-49be-b9eb-d815b0448fb0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a8116-e6b9-4062-b55c-f01f7a0138e3]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:34 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:34 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f94673-82da-40e0-b46b-9f73e57982e9]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:23:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26664303365396130', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26664303365396130', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-334831865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:23:35 user nova-compute[75621]:   <uuid>4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</uuid>
Nov 27 23:23:35 user nova-compute[75621]:   <name>instance-00000026</name>
Nov 27 23:23:35 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:23:35 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:23:35 user nova-compute[75621]:   <metadata>
Nov 27 23:23:35 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:23:35 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:23:35 user nova-compute[75621]:       <nova:name>tempest-ServerActionsV293TestJSON-server-334831865</nova:name>
Nov 27 23:23:35 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:23:34</nova:creationTime>
Nov 27 23:23:35 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:23:35 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:23:35 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:23:35 user nova-compute[75621]:       <nova:owner>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:user uuid="80b871115ca74f63af6dc4898e5cc991">tempest-ServerActionsV293TestJSON-1008450179-project-member</nova:user>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:project uuid="c299c8c8ab56464fabf11c255b22c2f0">tempest-ServerActionsV293TestJSON-1008450179</nova:project>
Nov 27 23:23:35 user nova-compute[75621]:       </nova:owner>
Nov 27 23:23:35 user nova-compute[75621]:       <nova:ports>
Nov 27 23:23:35 user nova-compute[75621]:         <nova:port uuid="a767daef-0980-48e7-9665-303518745042">
Nov 27 23:23:35 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 27 23:23:35 user nova-compute[75621]:         </nova:port>
Nov 27 23:23:35 user nova-compute[75621]:       </nova:ports>
Nov 27 23:23:35 user nova-compute[75621]:     </nova:instance>
Nov 27 23:23:35 user nova-compute[75621]:   </metadata>
Nov 27 23:23:35 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:23:35 user nova-compute[75621]:     <system>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="serial">4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</entry>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="uuid">4462c3d9-f8e5-4c2c-aef9-6275d22d04e9</entry>
Nov 27 23:23:35 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:23:35 user nova-compute[75621]:     </system>
Nov 27 23:23:35 user nova-compute[75621]:   </sysinfo>
Nov 27 23:23:35 user nova-compute[75621]:   <os>
Nov 27 23:23:35 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:23:35 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:23:35 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:23:35 user nova-compute[75621]:   </os>
Nov 27 23:23:35 user nova-compute[75621]:   <features>
Nov 27 23:23:35 user nova-compute[75621]:     <acpi/>
Nov 27 23:23:35 user nova-compute[75621]:     <apic/>
Nov 27 23:23:35 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:23:35 user nova-compute[75621]:   </features>
Nov 27 23:23:35 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:23:35 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:23:35 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:23:35 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:23:35 user nova-compute[75621]:   </clock>
Nov 27 23:23:35 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:23:35 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:23:35 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:23:35 user nova-compute[75621]:   </cpu>
Nov 27 23:23:35 user nova-compute[75621]:   <devices>
Nov 27 23:23:35 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:23:35 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:23:35 user nova-compute[75621]:       <source dev="/dev/sdd"/>
Nov 27 23:23:35 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:23:35 user nova-compute[75621]:       <serial>093592e0-0da3-4368-8c87-e6a937fad0cf</serial>
Nov 27 23:23:35 user nova-compute[75621]:     </disk>
Nov 27 23:23:35 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:23:35 user nova-compute[75621]:       <mac address="fa:16:3e:40:73:32"/>
Nov 27 23:23:35 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:35 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:23:35 user nova-compute[75621]:       <target dev="tapa767daef-09"/>
Nov 27 23:23:35 user nova-compute[75621]:     </interface>
Nov 27 23:23:35 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:23:35 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9/console.log" append="off"/>
Nov 27 23:23:35 user nova-compute[75621]:     </serial>
Nov 27 23:23:35 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:23:35 user nova-compute[75621]:     <video>
Nov 27 23:23:35 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:23:35 user nova-compute[75621]:     </video>
Nov 27 23:23:35 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:23:35 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:23:35 user nova-compute[75621]:     </rng>
Nov 27 23:23:35 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:23:35 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:23:35 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:23:35 user nova-compute[75621]:     </memballoon>
Nov 27 23:23:35 user nova-compute[75621]:   </devices>
Nov 27 23:23:35 user nova-compute[75621]: </domain>
Nov 27 23:23:35 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-334831865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:23:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG os_vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f81adc54-1ca0-5424-bd47-4e0df276356f', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa767daef-09, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa767daef-09, col_values=(('qos', UUID('d4611441-40a5-427e-b187-a2630669a085')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa767daef-09, col_values=(('external_ids', {'iface-id': 'a767daef-0980-48e7-9665-303518745042', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:73:32', 'vm-uuid': '4462c3d9-f8e5-4c2c-aef9-6275d22d04e9'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:35 user nova-compute[75621]: INFO os_vif [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09')
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:23:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] No VIF found with MAC fa:16:3e:40:73:32, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:23:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:37 user nova-compute[75621]: WARNING nova.compute.manager [req-8bb73e45-5a97-452f-9d6b-d361f09c335f req-9b6ed28e-1759-4518-8054-87c6c66b5aaa service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 23:23:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 is timed out.
Nov 27 23:23:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully detached device vdb from instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 from the live domain config.
Nov 27 23:23:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UdjTyfEL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:23:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[228451fd-139e-4b80-b919-f9f2a22ef409]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:23:37 user nova-compute[75621]: No targets found.
Nov 27 23:23:37 user nova-compute[75621]: iSNS:
Nov 27 23:23:37 user nova-compute[75621]: No targets found.
Nov 27 23:23:37 user nova-compute[75621]: STATIC:
Nov 27 23:23:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe
Nov 27 23:23:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:23:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e
Nov 27 23:23:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:37 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf
Nov 27 23:23:37 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:23:37 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:23:37 user nova-compute[75621]: FIRMWARE:
Nov 27 23:23:37 user nova-compute[75621]: No targets found.
Nov 27 23:23:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:23:37 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:23:37 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1aa5a7-a132-447d-b18a-158084c44bae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[664468f7-1b30-4974-b344-4be0c30dcc1f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe (non-flash)
Nov 27 23:23:37 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:23:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05737f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe'): ({'sdf'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Removing single pathed devices sdf {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d27494-88f1-4f09-8fd5-da2931483dba]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[99078d10-136e-4f5b-9784-5597d126f406]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Flushing IO for device /dev/sdf {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8709a1c-35c2-4992-b947-6349943d0ff6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7d5371-2e74-4873-a4d2-85ee4f14246f]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] SCSI volumes sdf have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d5d1f-4dd5-4e41-8b7a-53c8ae6b61a0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb09bee-3796-4c08-a4e4-2c3072ae2af9]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260]
Nov 27 23:23:37 user nova-compute[75621]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe, portal: 172.16.0.220,3260] successful.
Nov 27 23:23:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb073065-52ee-478c-bc71-1ca0359ee3fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2651cfdb-6178-4235-b26a-bc0b811c2547]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] <== disconnect_volume: return (329ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:23:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:23:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'flavor' on Instance uuid 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:23:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-11ec2969-c07f-4838-b2b5-b75adc701496 tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.999s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:23:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance spawned successfully.
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:23:39 user nova-compute[75621]: WARNING nova.compute.manager [req-c4837477-45b5-40ef-a396-8fdbe44e2f5d req-f88c4d11-5df9-4361-befb-a4ec4bd650d0 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state active and task_state rebuild_spawning.
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75621) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ecf5189e-8fe1-49bc-adf9-d6e7ae913f37 tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:23:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:23:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:23:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:24:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:05 user nova-compute[75621]: INFO nova.compute.manager [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Terminating instance
Nov 27 23:24:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG nova.compute.manager [req-5284665b-0aa4-402d-9910-25f779aaaeb0 req-948fdce0-3d72-4bd7-a20c-3cbfb0b9f31f service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:24:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Instance destroyed successfully.
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.objects.instance [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lazy-loading 'resources' on Instance uuid 2f29bb32-a98b-480c-a5fa-9dbec4a12df2 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-849995852',display_name='tempest-VolumesActionsTest-instance-849995852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-849995852',id=40,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:22:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-ln7k0jxq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:22:21Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=2f29bb32-a98b-480c-a5fa-9dbec4a12df2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "address": "fa:16:3e:49:89:a4", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1a7cdb7-e3", "ovs_interfaceid": "e1a7cdb7-e381-4288-8b88-9d5a357c375f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG os_vif [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1a7cdb7-e3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a26c1f69-e4cb-43d8-9fcc-3a1fab6ff0a2) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:06 user nova-compute[75621]: INFO os_vif [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:89:a4,bridge_name='br-int',has_traffic_filtering=True,id=e1a7cdb7-e381-4288-8b88-9d5a357c375f,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1a7cdb7-e3')
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Deleting instance files /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2_del
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Deletion of /opt/stack/data/nova/instances/2f29bb32-a98b-480c-a5fa-9dbec4a12df2_del complete
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.compute.manager [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-668dce37-0e1c-481b-80bf-6b726d1e2167 req-d1f1c7ef-fd2f-46e3-bdc9-3a5b16a35b62 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-deleted-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.compute.manager [req-668dce37-0e1c-481b-80bf-6b726d1e2167 req-d1f1c7ef-fd2f-46e3-bdc9-3a5b16a35b62 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Neutron deleted interface e1a7cdb7-e381-4288-8b88-9d5a357c375f; detaching it from the instance and deleting it from the info cache
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.network.neutron [req-668dce37-0e1c-481b-80bf-6b726d1e2167 req-d1f1c7ef-fd2f-46e3-bdc9-3a5b16a35b62 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.compute.manager [req-668dce37-0e1c-481b-80bf-6b726d1e2167 req-d1f1c7ef-fd2f-46e3-bdc9-3a5b16a35b62 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Detach interface failed, port_id=e1a7cdb7-e381-4288-8b88-9d5a357c375f, reason: Instance 2f29bb32-a98b-480c-a5fa-9dbec4a12df2 could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Took 0.54 seconds to deallocate network for instance.
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:06 user nova-compute[75621]: INFO nova.compute.manager [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Terminating instance
Nov 27 23:24:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.677s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Deleted allocations for instance 2f29bb32-a98b-480c-a5fa-9dbec4a12df2
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-fd30303c-71fe-426e-82a8-b93517d81f6f tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Instance destroyed successfully.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lazy-loading 'resources' on Instance uuid 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:21:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-360957302',display_name='tempest-AttachVolumeNegativeTest-server-360957302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-360957302',id=39,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMllNU9jOjorjR8b1rlrWE7W+8zrhTd3vfSrgFr9BkVfWy2lM0HCcqasMtAKVXYkIB5wU4yP/BSeNFvMTVHDmPP4HksJWrxZARrIHCi05ox8cKF3T98ebyrzVEJavUjcEw==',key_name='tempest-keypair-1572840474',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='565ce700aeda4eb49c85cd697a9c0736',ramdisk_id='',reservation_id='r-102699j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-862898080',owner_user_name='tempest-AttachVolumeNegativeTest-862898080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c7f3a4fe69a492aab4db9062a6d838b',uuid=6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converting VIF {"id": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "address": "fa:16:3e:23:95:44", "network": {"id": "18ff94bf-ee4a-44b8-9eec-a8a69817c79b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1290078149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "565ce700aeda4eb49c85cd697a9c0736", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ed9677c-98", "ovs_interfaceid": "5ed9677c-988a-4f5f-9c7c-b4a7dc56017b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG os_vif [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ed9677c-98, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=607bda22-cea4-4ad2-b775-b30923273af6) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:07 user nova-compute[75621]: INFO os_vif [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:95:44,bridge_name='br-int',has_traffic_filtering=True,id=5ed9677c-988a-4f5f-9c7c-b4a7dc56017b,network=Network(18ff94bf-ee4a-44b8-9eec-a8a69817c79b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ed9677c-98')
Nov 27 23:24:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Deleting instance files /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80_del
Nov 27 23:24:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Deletion of /opt/stack/data/nova/instances/6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80_del complete
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state deleted and task_state None.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state deleted and task_state None.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state deleted and task_state None.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-unplugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state deleted and task_state None.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "2f29bb32-a98b-480c-a5fa-9dbec4a12df2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] No waiting events found dispatching network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 2f29bb32-a98b-480c-a5fa-9dbec4a12df2] Received unexpected event network-vif-plugged-e1a7cdb7-e381-4288-8b88-9d5a357c375f for instance with vm_state deleted and task_state None.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-unplugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] No waiting events found dispatching network-vif-unplugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-unplugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Acquiring lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] No waiting events found dispatching network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:07 user nova-compute[75621]: WARNING nova.compute.manager [req-6ef39883-bc54-4385-9c3a-b6fee04bdeac req-589e537e-edd8-4c69-9c8d-9edd50dd37a2 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received unexpected event network-vif-plugged-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b for instance with vm_state active and task_state deleting.
Nov 27 23:24:07 user nova-compute[75621]: INFO nova.compute.manager [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:24:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:08 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Took 0.60 seconds to deallocate network for instance.
Nov 27 23:24:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.265s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:08 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Deleted allocations for instance 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80
Nov 27 23:24:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-67a30fbc-b8d0-48e1-82fb-695755f62e75 req-009b2180-0b84-445f-abc8-9786d005eb67 service nova] [instance: 6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80] Received event network-vif-deleted-5ed9677c-988a-4f5f-9c7c-b4a7dc56017b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3bee962c-8e07-4299-94e3-a2d509a731ba tempest-AttachVolumeNegativeTest-862898080 tempest-AttachVolumeNegativeTest-862898080-project-member] Lock "6dd45a4c-a1f2-45a6-b4b9-4100dfcf8c80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.907s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:10 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:24:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8020MB free_disk=25.04439926147461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b9193c89-2a48-45c6-bbf2-2d7363bf565e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8320d0ba-f01c-4d46-913f-2b125aaa759e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6c37c104-1220-4672-a140-54a62f398b44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d69bddaf-9708-4d98-a10a-8f38a660abf0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8e45e11-3732-4bf0-959e-79963cf8ac3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:24:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:24:16 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [{"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b9193c89-2a48-45c6-bbf2-2d7363bf565e" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:24:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:24:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:19 user nova-compute[75621]: INFO nova.compute.manager [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Terminating instance
Nov 27 23:24:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-228ffac1-a18b-4df3-abb0-f51aba78eab6 req-63824b29-0f78-4d96-88c6-eea93ac0dd02 service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-unplugged-3972e087-3518-423e-9486-93d6a399f90c for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Instance destroyed successfully.
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid 8320d0ba-f01c-4d46-913f-2b125aaa759e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1132236675',display_name='tempest-ServerRescueNegativeTestJSON-server-1132236675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1132236675',id=24,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:10:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-kg4byl4s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:10:12Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=8320d0ba-f01c-4d46-913f-2b125aaa759e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "3972e087-3518-423e-9486-93d6a399f90c", "address": "fa:16:3e:f4:61:1a", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3972e087-35", "ovs_interfaceid": "3972e087-3518-423e-9486-93d6a399f90c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG os_vif [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3972e087-35, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c91ea441-4aa9-4e04-84b8-55ae42e107cb) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: INFO os_vif [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:61:1a,bridge_name='br-int',has_traffic_filtering=True,id=3972e087-3518-423e-9486-93d6a399f90c,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3972e087-35')
Nov 27 23:24:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Deleting instance files /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e_del
Nov 27 23:24:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Deletion of /opt/stack/data/nova/instances/8320d0ba-f01c-4d46-913f-2b125aaa759e_del complete
Nov 27 23:24:20 user nova-compute[75621]: INFO nova.compute.manager [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 23:24:20 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:21 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Took 0.68 seconds to deallocate network for instance.
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Deleted allocations for instance 8320d0ba-f01c-4d46-913f-2b125aaa759e
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-132e65fa-5160-49cb-ae8a-3e4822eca206 tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.982s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:21 user nova-compute[75621]: WARNING nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state deleted and task_state None.
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:21 user nova-compute[75621]: WARNING nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state deleted and task_state None.
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:21 user nova-compute[75621]: WARNING nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state deleted and task_state None.
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Acquiring lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] Lock "8320d0ba-f01c-4d46-913f-2b125aaa759e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] No waiting events found dispatching network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:21 user nova-compute[75621]: WARNING nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received unexpected event network-vif-plugged-3972e087-3518-423e-9486-93d6a399f90c for instance with vm_state deleted and task_state None.
Nov 27 23:24:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-80373cb1-fb4d-42ec-9f35-cf780b1917d4 req-c6654aad-67bf-40ab-9e2d-3a26bf96beeb service nova] [instance: 8320d0ba-f01c-4d46-913f-2b125aaa759e] Received event network-vif-deleted-3972e087-3518-423e-9486-93d6a399f90c {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:24:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:24:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-changed-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Refreshing instance network info cache due to event network-changed-5ea1c23d-a361-4755-8078-bd9681acff17. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] Acquiring lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] Acquired lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Refreshing network info cache for port 5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:47 user nova-compute[75621]: INFO nova.compute.manager [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Terminating instance
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updated VIF entry in instance network info cache for port 5ea1c23d-a361-4755-8078-bd9681acff17. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updating instance_info_cache with network_info: [{"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9149d7ed-f0f8-4285-bc6a-f7ed9f2ed55a req-8751ba1b-192a-4da9-a06f-9f75dd52eaaa service nova] Releasing lock "refresh_cache-d69bddaf-9708-4d98-a10a-8f38a660abf0" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:47 user nova-compute[75621]: INFO nova.compute.manager [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Terminating instance
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-unplugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] No waiting events found dispatching network-vif-unplugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-2f8f9a52-a7f3-464f-bedf-07dccc853bf2 req-e38fbc3d-4efc-4a17-b080-fd55c9431e97 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-unplugged-5ea1c23d-a361-4755-8078-bd9681acff17 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Instance destroyed successfully.
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lazy-loading 'resources' on Instance uuid 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-27T23:21:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-334831865',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-215985664',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpjXX2n2Z882XkqVFmjtKk8DQ7FmwAfHzJrYg2dbsVhbJ1HiWaAEzW7e5Avaf+gXbB7NvFFYjSw9kaUROecFHZ/9GlSDW8OmVD8SO8FYF3Ek8wvg0j0DkNhSa0dQlbCwQ==',key_name='tempest-keypair-796039720',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:23:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c299c8c8ab56464fabf11c255b22c2f0',ramdisk_id='',reservation_id='r-i7cnt8go',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1008450179',owner_user_name='tempest-ServerActionsV293TestJSON-1008450179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:23:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='80b871115ca74f63af6dc4898e5cc991',uuid=4462c3d9-f8e5-4c2c-aef9-6275d22d04e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converting VIF {"id": "a767daef-0980-48e7-9665-303518745042", "address": "fa:16:3e:40:73:32", "network": {"id": "5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1736045995-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c299c8c8ab56464fabf11c255b22c2f0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa767daef-09", "ovs_interfaceid": "a767daef-0980-48e7-9665-303518745042", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_vif [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa767daef-09, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4611441-40a5-427e-b187-a2630669a085) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: INFO os_vif [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:73:32,bridge_name='br-int',has_traffic_filtering=True,id=a767daef-0980-48e7-9665-303518745042,network=Network(5ebee9f9-d6d4-4ef0-a9c2-d80dc35663ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa767daef-09')
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HscrXbOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:24:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd79fd-d511-4344-806a-9de0a8f746b2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]: iSNS:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]: STATIC:
Nov 27 23:24:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:24:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:24:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:24:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e
Nov 27 23:24:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:24:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:24:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf
Nov 27 23:24:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:24:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:24:48 user nova-compute[75621]: FIRMWARE:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:24:48 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:24:48 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fa84d-d07b-470a-8f87-f918155ba1ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3d9679-e86d-45db-bebc-926727545b92]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf (non-flash)
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05e7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40aef37-ab5c-410e-bfc0-bea9c63c957b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1f5424-ac85-4aa5-8928-b2818f75ffc3]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.097s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[780501e7-47ce-4b79-a2bb-b0eca0ad9c75]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Instance destroyed successfully.
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid d69bddaf-9708-4d98-a10a-8f38a660abf0 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.105s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6947a65-d2d2-467b-870b-bf34fb5bb06b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:22:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-246167655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-246167655',id=41,image_ref='c1683c2f-cf52-4eef-b965-dbe641a012b9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATgyCA7/y5VfMtylbRpV2Aa0o8Zyoi7tQTR9XDoaztLa8BCAEygYwNKo4II2CxeQJHhRvEWkrxD74iJX7pa5xowQJLQtHMlZ8CU3nZNNcJsKSEgF81BoiYEw7yPsJpKow==',key_name='tempest-keypair-1612792955',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:23:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-y1oz7mjn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-11911166',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:23:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d69bddaf-9708-4d98-a10a-8f38a660abf0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5ea1c23d-a361-4755-8078-bd9681acff17", "address": "fa:16:3e:d0:b3:b3", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea1c23d-a3", "ovs_interfaceid": "5ea1c23d-a361-4755-8078-bd9681acff17", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_vif [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea1c23d-a3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2bd16dc-8d64-496a-adcb-4953f19e5413) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[291b8fbc-d9b9-40af-8a9c-ee01d4721efa]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: INFO os_vif [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:b3:b3,bridge_name='br-int',has_traffic_filtering=True,id=5ea1c23d-a361-4755-8078-bd9681acff17,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea1c23d-a3')
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uBxDJKpj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:24:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b74a22-f3f5-4787-bcf5-43df307e86da]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260]
Nov 27 23:24:48 user nova-compute[75621]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf, portal: 172.16.0.220,3260] successful.
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:093592e0-0da3-4368-8c87-e6a937fad0cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb217679-98bb-4634-b39f-45c71e623497]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.520s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] <== disconnect_volume: return (521ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deleting instance files /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9_del
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deletion of /opt/stack/data/nova/instances/4462c3d9-f8e5-4c2c-aef9-6275d22d04e9_del complete
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.094s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c8d4b1-3ed9-4fc4-8539-56428bea7024]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]: iSNS:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]: STATIC:
Nov 27 23:24:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:24:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:24:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:24:48 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e
Nov 27 23:24:48 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:24:48 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:24:48 user nova-compute[75621]: FIRMWARE:
Nov 27 23:24:48 user nova-compute[75621]: No targets found.
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:24:48 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:24:48 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eacde16-3de2-4555-8eda-89e172820070]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.compute.manager [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Took 1.44 seconds to destroy the instance on the hypervisor.
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ad25bf-55ed-4678-921b-86889a7bad66]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:24:48 user nova-compute[75621]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e (non-flash)
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0573250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa753d4-05ab-4a9a-a970-cf1125f5caac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c60a0d8-8857-4baf-82f5-a78ef322e62a]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3189a100-8b7f-4c0d-a46c-c543e5c0da25]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7150a2-7eb9-4d31-a48d-eabe453293b9]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8d2279-f879-46ba-b931-6ad6014cff94]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1b7801-015f-4542-b193-8c077742b85e]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260]
Nov 27 23:24:48 user nova-compute[75621]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e, portal: 172.16.0.220,3260] successful.
Nov 27 23:24:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e54b191d-1a48-478e-876d-ea1e9f88e83e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96c006f-a6ea-4d55-bb6c-c3bd5f0ec275]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (396ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:24:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Deleting instance files /opt/stack/data/nova/instances/d69bddaf-9708-4d98-a10a-8f38a660abf0_del
Nov 27 23:24:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Deletion of /opt/stack/data/nova/instances/d69bddaf-9708-4d98-a10a-8f38a660abf0_del complete
Nov 27 23:24:49 user nova-compute[75621]: INFO nova.compute.manager [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-unplugged-a767daef-0980-48e7-9665-303518745042 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Acquiring lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] No waiting events found dispatching network-vif-plugged-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:49 user nova-compute[75621]: WARNING nova.compute.manager [req-1cf686c9-1341-470b-b462-f8e50226efbc req-a4aade1f-41d5-4af1-a1d7-5df6bb121588 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received unexpected event network-vif-plugged-a767daef-0980-48e7-9665-303518745042 for instance with vm_state active and task_state deleting.
Nov 27 23:24:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:49 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Took 0.75 seconds to deallocate network for instance.
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-054870e0-5cf0-4c97-b8c0-e4c5ef581329 req-032bdc7d-8413-4ee0-8127-6694d4369113 service nova] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Received event network-vif-deleted-a767daef-0980-48e7-9665-303518745042 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:49 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Took 0.84 seconds to deallocate network for instance.
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] Acquiring lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] No waiting events found dispatching network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:24:50 user nova-compute[75621]: WARNING nova.compute.manager [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received unexpected event network-vif-plugged-5ea1c23d-a361-4755-8078-bd9681acff17 for instance with vm_state active and task_state deleting.
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-73aff431-877a-4f2c-a053-08b653b6498f req-d7206777-7684-4459-8239-f5a22bf97c94 service nova] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Received event network-vif-deleted-5ea1c23d-a361-4755-8078-bd9681acff17 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:50 user nova-compute[75621]: INFO nova.compute.manager [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Took 0.89 seconds to detach 1 volumes for instance.
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] [instance: 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9] Deleting volume: 093592e0-0da3-4368-8c87-e6a937fad0cf {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:50 user nova-compute[75621]: INFO nova.compute.manager [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Took 0.77 seconds to detach 1 volumes for instance.
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d69bddaf-9708-4d98-a10a-8f38a660abf0] Deleting volume: e54b191d-1a48-478e-876d-ea1e9f88e83e {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:50 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Deleted allocations for instance 4462c3d9-f8e5-4c2c-aef9-6275d22d04e9
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e0910f08-2b94-42c6-ac63-68c58a1d924c tempest-ServerActionsV293TestJSON-1008450179 tempest-ServerActionsV293TestJSON-1008450179-project-member] Lock "4462c3d9-f8e5-4c2c-aef9-6275d22d04e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:50 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance d69bddaf-9708-4d98-a10a-8f38a660abf0
Nov 27 23:24:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cd0bdb0c-88e0-4237-b9ac-38002db9aa32 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d69bddaf-9708-4d98-a10a-8f38a660abf0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.382s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:56 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:24:56 user nova-compute[75621]: INFO nova.compute.claims [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Claim successful on node user
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:24:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.policy [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8063d26e4982455497e74bf4234831c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225ed56580174c82872d16a37c20b84a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:24:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Creating image(s)
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "/opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "/opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.226s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk 1073741824" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.404s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Successfully created port: 2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Cannot resize image /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Ensure instance console log exists: /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Successfully updated port: 2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquired lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-changed-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Refreshing instance network info cache due to event network-changed-2ed6aafa-b377-4003-a9fd-19ef0a336b1d. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] Acquiring lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:24:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.neutron [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Updating instance_info_cache with network_info: [{"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Releasing lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Instance network_info: |[{"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] Acquired lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Refreshing network info cache for port 2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Start _get_guest_xml network_info=[{"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:24:59 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:24:59 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644945194',display_name='tempest-VolumesActionsTest-instance-1644945194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644945194',id=43,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-txpsizbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:24:57Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=9a018a62-cab5-4019-bb21-8717c226159f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.objects.instance [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a018a62-cab5-4019-bb21-8717c226159f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:24:59 user nova-compute[75621]:   <uuid>9a018a62-cab5-4019-bb21-8717c226159f</uuid>
Nov 27 23:24:59 user nova-compute[75621]:   <name>instance-0000002b</name>
Nov 27 23:24:59 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:24:59 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:24:59 user nova-compute[75621]:   <metadata>
Nov 27 23:24:59 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:24:59 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:name>tempest-VolumesActionsTest-instance-1644945194</nova:name>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:24:59</nova:creationTime>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:24:59 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:24:59 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:owner>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:user uuid="8063d26e4982455497e74bf4234831c3">tempest-VolumesActionsTest-89555776-project-member</nova:user>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:project uuid="225ed56580174c82872d16a37c20b84a">tempest-VolumesActionsTest-89555776</nova:project>
Nov 27 23:24:59 user nova-compute[75621]:       </nova:owner>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:24:59 user nova-compute[75621]:       <nova:ports>
Nov 27 23:24:59 user nova-compute[75621]:         <nova:port uuid="2ed6aafa-b377-4003-a9fd-19ef0a336b1d">
Nov 27 23:24:59 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 27 23:24:59 user nova-compute[75621]:         </nova:port>
Nov 27 23:24:59 user nova-compute[75621]:       </nova:ports>
Nov 27 23:24:59 user nova-compute[75621]:     </nova:instance>
Nov 27 23:24:59 user nova-compute[75621]:   </metadata>
Nov 27 23:24:59 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:24:59 user nova-compute[75621]:     <system>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="serial">9a018a62-cab5-4019-bb21-8717c226159f</entry>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="uuid">9a018a62-cab5-4019-bb21-8717c226159f</entry>
Nov 27 23:24:59 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:24:59 user nova-compute[75621]:     </system>
Nov 27 23:24:59 user nova-compute[75621]:   </sysinfo>
Nov 27 23:24:59 user nova-compute[75621]:   <os>
Nov 27 23:24:59 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:24:59 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:24:59 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:24:59 user nova-compute[75621]:   </os>
Nov 27 23:24:59 user nova-compute[75621]:   <features>
Nov 27 23:24:59 user nova-compute[75621]:     <acpi/>
Nov 27 23:24:59 user nova-compute[75621]:     <apic/>
Nov 27 23:24:59 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:24:59 user nova-compute[75621]:   </features>
Nov 27 23:24:59 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:24:59 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:24:59 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:24:59 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:24:59 user nova-compute[75621]:   </clock>
Nov 27 23:24:59 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:24:59 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:24:59 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:24:59 user nova-compute[75621]:   </cpu>
Nov 27 23:24:59 user nova-compute[75621]:   <devices>
Nov 27 23:24:59 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:24:59 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:24:59 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk"/>
Nov 27 23:24:59 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:24:59 user nova-compute[75621]:     </disk>
Nov 27 23:24:59 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:24:59 user nova-compute[75621]:       <mac address="fa:16:3e:b8:39:5d"/>
Nov 27 23:24:59 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:24:59 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:24:59 user nova-compute[75621]:       <target dev="tap2ed6aafa-b3"/>
Nov 27 23:24:59 user nova-compute[75621]:     </interface>
Nov 27 23:24:59 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:24:59 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/console.log" append="off"/>
Nov 27 23:24:59 user nova-compute[75621]:     </serial>
Nov 27 23:24:59 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:24:59 user nova-compute[75621]:     <video>
Nov 27 23:24:59 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:24:59 user nova-compute[75621]:     </video>
Nov 27 23:24:59 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:24:59 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:24:59 user nova-compute[75621]:     </rng>
Nov 27 23:24:59 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:24:59 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:24:59 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:24:59 user nova-compute[75621]:     </memballoon>
Nov 27 23:24:59 user nova-compute[75621]:   </devices>
Nov 27 23:24:59 user nova-compute[75621]: </domain>
Nov 27 23:24:59 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644945194',display_name='tempest-VolumesActionsTest-instance-1644945194',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644945194',id=43,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-txpsizbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:24:57Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=9a018a62-cab5-4019-bb21-8717c226159f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG os_vif [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81d3de58-2049-5251-9f3c-18398e77907e', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ed6aafa-b3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ed6aafa-b3, col_values=(('qos', UUID('abe1ea20-ea4d-46bc-ac9b-93dd592bc1ee')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ed6aafa-b3, col_values=(('external_ids', {'iface-id': '2ed6aafa-b377-4003-a9fd-19ef0a336b1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:39:5d', 'vm-uuid': '9a018a62-cab5-4019-bb21-8717c226159f'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:24:59 user nova-compute[75621]: INFO os_vif [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3')
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] No VIF found with MAC fa:16:3e:b8:39:5d, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Updated VIF entry in instance network info cache for port 2ed6aafa-b377-4003-a9fd-19ef0a336b1d. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG nova.network.neutron [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Updating instance_info_cache with network_info: [{"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:24:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-45b8f547-e713-48db-8d14-8f57d73ed2f1 req-88367c3f-1ea2-4986-b553-2a4d8cb54821 service nova] Releasing lock "refresh_cache-9a018a62-cab5-4019-bb21-8717c226159f" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:00 user nova-compute[75621]: DEBUG nova.compute.manager [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] No waiting events found dispatching network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:00 user nova-compute[75621]: WARNING nova.compute.manager [req-965ad85a-7b94-47d5-aa7b-ec6462d4926a req-3a4c8eb8-f490-42ee-bb80-46344c9c66f4 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received unexpected event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d for instance with vm_state building and task_state spawning.
Nov 27 23:25:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:01 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:25:02 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Instance spawned successfully.
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:02 user nova-compute[75621]: DEBUG nova.compute.manager [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] No waiting events found dispatching network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:02 user nova-compute[75621]: WARNING nova.compute.manager [req-db3aefa8-33a8-498c-8758-5c8c35d18a21 req-30239db0-5da6-4448-978a-89487152ebb8 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received unexpected event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d for instance with vm_state building and task_state spawning.
Nov 27 23:25:02 user nova-compute[75621]: INFO nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-changed-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.compute.manager [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Refreshing instance network info cache due to event network-changed-120638fa-e253-4877-b65a-4d918b0a7e3a. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] Acquiring lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] Acquired lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Refreshing network info cache for port 120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:25:03 user nova-compute[75621]: INFO nova.compute.manager [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Took 6.25 seconds to build instance.
Nov 27 23:25:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-a36e7b3b-ac08-4998-a872-330ad534dc21 tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.346s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updated VIF entry in instance network info cache for port 120638fa-e253-4877-b65a-4d918b0a7e3a. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG nova.network.neutron [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating instance_info_cache with network_info: [{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:25:03 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9b70ec42-7de2-43cb-8ad1-78d88a172183 req-b330d5ef-4b36-4876-93c9-5dc345cea831 service nova] Releasing lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG nova.objects.instance [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.280s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:04 user nova-compute[75621]: INFO nova.compute.manager [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attaching volume c98272ae-daf3-4b4c-915d-20021092ef10 to /dev/vdb
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.utils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef6be5f-290d-4756-9c08-d327156af94a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba49d5-7163-4521-8a33-f3aea3c24496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a739781-d342-4b50-87f4-16cac82cdc3e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635e77f-f0e8-437a-816c-cea1b82dcdeb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:25:04 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:25:04 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbae655-8e06-4eef-8ccf-f2aab5029f02]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG os_brick.utils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:04 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating existing volume attachment record: 5ce9454d-d771-45d7-bd81-4f3a0fa21aa2 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:25:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:10 user nova-compute[75621]: INFO nova.compute.manager [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Terminating instance
Nov 27 23:25:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:10 user nova-compute[75621]: DEBUG nova.compute.manager [req-7c26b1f3-2561-46cd-97be-9ada16a0c835 req-fef0e2c5-a4c2-461e-b462-0b2bfc3af295 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-unplugged-76823b6c-283b-4999-893a-8766802981ec for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:25:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Instance destroyed successfully.
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lazy-loading 'resources' on Instance uuid b9193c89-2a48-45c6-bbf2-2d7363bf565e {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:08:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-563489341',display_name='tempest-ServerRescueNegativeTestJSON-server-563489341',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-563489341',id=23,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:13:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0c922ea90054fc0b2220e2431ea900b',ramdisk_id='',reservation_id='r-f81o6anz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1406378656',owner_user_name='tempest-ServerRescueNegativeTestJSON-1406378656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:14:56Z,user_data=None,user_id='3ef6cc601c4e455595057cb4d0dc33b7',uuid=b9193c89-2a48-45c6-bbf2-2d7363bf565e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converting VIF {"id": "76823b6c-283b-4999-893a-8766802981ec", "address": "fa:16:3e:5f:e8:d7", "network": {"id": "4f742bd2-ceda-4722-ac10-ba0118ec7013", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-509621919-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0c922ea90054fc0b2220e2431ea900b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76823b6c-28", "ovs_interfaceid": "76823b6c-283b-4999-893a-8766802981ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_vif [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76823b6c-28, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9b2cc25-ecfc-4f5c-9851-80db23eb01e3) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: INFO os_vif [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:e8:d7,bridge_name='br-int',has_traffic_filtering=True,id=76823b6c-283b-4999-893a-8766802981ec,network=Network(4f742bd2-ceda-4722-ac10-ba0118ec7013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76823b6c-28')
Nov 27 23:25:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Deleting instance files /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e_del
Nov 27 23:25:11 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Deletion of /opt/stack/data/nova/instances/b9193c89-2a48-45c6-bbf2-2d7363bf565e_del complete
Nov 27 23:25:11 user nova-compute[75621]: INFO nova.compute.manager [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 27 23:25:11 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:25:11 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Took 0.63 seconds to deallocate network for instance.
Nov 27 23:25:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxQgJGbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:11 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:11 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:11 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:25:11 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[806cdab4-b0fa-480f-882a-98a03d46af0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:25:12 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[624aed1a-4189-46b4-b5cf-1188297b818c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10] added
Nov 27 23:25:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e27a934-61c7-4c1f-88d8-3f36293aab81]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.085s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.038s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5435c07a-c7f7-4bcc-a584-0b53ab3b3fb5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxQgJGbe {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxQgJGbe" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb2844-3c59-456c-94cd-2687b0e64dc1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxQgJGbe'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Deleted allocations for instance b9193c89-2a48-45c6-bbf2-2d7363bf565e
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12371aa8-4287-4987-8c83-0bcff9e9496b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce20211-0398-42d9-b028-f0ccaa1f9327]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc9eb0e8-bf5c-4d3a-8a75-fcef9d10601b tempest-ServerRescueNegativeTestJSON-1406378656 tempest-ServerRescueNegativeTestJSON-1406378656-project-member] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.029s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] Acquiring lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] Lock "b9193c89-2a48-45c6-bbf2-2d7363bf565e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] No waiting events found dispatching network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:12 user nova-compute[75621]: WARNING nova.compute.manager [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received unexpected event network-vif-plugged-76823b6c-283b-4999-893a-8766802981ec for instance with vm_state deleted and task_state None.
Nov 27 23:25:12 user nova-compute[75621]: DEBUG nova.compute.manager [req-670b87aa-0350-417f-a389-a999a1148548 req-9975e603-c336-4891-b84a-264cf6b034c6 service nova] [instance: b9193c89-2a48-45c6-bbf2-2d7363bf565e] Received event network-vif-deleted-76823b6c-283b-4999-893a-8766802981ec {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --login" returned: 0 in 1.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c7400e-016e-4a2f-b42b-e7330d815625]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260]
Nov 27 23:25:13 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260] successful.
Nov 27 23:25:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:25:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8560MB free_disk=25.08940887451172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7409e4-7a62-44de-a19a-1f286e74875c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7025748-ad0a-45cd-9dd6-0a3a91b0027e]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:13 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:13 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.544s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[686090ed-a1c6-40cc-b17b-8fdc038df2cd]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxQgJGbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 6c37c104-1220-4672-a140-54a62f398b44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8e45e11-3732-4bf0-959e-79963cf8ac3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 9a018a62-cab5-4019-bb21-8717c226159f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:25:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.322s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.585s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== connect_volume: return (2587ms) {'type': 'block', 'scsi_wwn': '26464303433636437', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464303433636437', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG nova.objects.instance [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:25:14 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:25:14 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:25:14 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:25:14 user nova-compute[75621]:   <serial>c98272ae-daf3-4b4c-915d-20021092ef10</serial>
Nov 27 23:25:14 user nova-compute[75621]: </disk>
Nov 27 23:25:14 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No VIF found with MAC fa:16:3e:e6:60:a3, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-090ad6db-040e-40b0-b918-392fe74de62f tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.084s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:25:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating instance_info_cache with network_info: [{"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-6c37c104-1220-4672-a140-54a62f398b44" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:25:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:25:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:20 user nova-compute[75621]: INFO nova.compute.manager [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attaching volume 348ac953-d1c7-4fa8-b27c-cab015c0036b to /dev/vdc
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.utils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4d138b-8405-4a41-b575-e25d65ccb4d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30faab2-9861-4942-96a1-620b3b20837d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[641ab70d-1d82-49cf-9639-3d209a8f7beb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321341a-0998-4ec6-b82e-878abe01b5ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:25:20 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:25:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d7a5aa-b602-438f-9213-781e733095b2]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG os_brick.utils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:20 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating existing volume attachment record: 082f58b3-22e7-4293-a2de-0120eeff389f {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:25:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrxLREqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:31 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:31 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:31 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e382c9d6-1a1a-4bd0-97af-5a2ff5f61c90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:25:31 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bab73b-592f-4641-924b-63f5f7f12dd4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b] added
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d911fd3-d2f8-4913-ac8b-0cc37b063a65]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadbc0f8-62b7-4ca6-b32d-3100fac2fdb1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrxLREqK {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WrxLREqK" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6500e33-509d-48c6-8ce4-6d3bc8401dd6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WrxLREqK'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57876b25-2afc-4f98-9c70-6e833eb56707]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fdec6d-ed24-4745-a87f-4c212f461200]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c25d51-14bd-4742-953d-73c03e62670b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260]
Nov 27 23:25:31 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260] successful.
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aad6001-2e50-4b07-9e96-9227f52ee22d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[df737bc0-68be-4480-840c-04cc5f4bd8b8]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:31 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:31 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e57f37b-6b71-4507-8b3e-d203295f717f]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:25:31 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrxLREqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:25:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:32 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23466316164373035', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466316164373035', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:25:32 user nova-compute[75621]: DEBUG nova.objects.instance [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:32 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:25:32 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:25:32 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:25:32 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:25:32 user nova-compute[75621]:   <serial>348ac953-d1c7-4fa8-b27c-cab015c0036b</serial>
Nov 27 23:25:32 user nova-compute[75621]: </disk>
Nov 27 23:25:32 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:25:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:25:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:25:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:25:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] No VIF found with MAC fa:16:3e:e6:60:a3, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:25:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-417f9ed2-3998-4dea-a924-73a7565a57d2 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.044s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:34 user nova-compute[75621]: INFO nova.compute.manager [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Detaching volume 348ac953-d1c7-4fa8-b27c-cab015c0036b
Nov 27 23:25:34 user nova-compute[75621]: INFO nova.virt.block_device [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attempting to driver detach volume 348ac953-d1c7-4fa8-b27c-cab015c0036b from mountpoint /dev/vdc
Nov 27 23:25:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Attempting to detach device vdc from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:25:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:25:34 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:25:34 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:25:34 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:25:34 user nova-compute[75621]:   <serial>348ac953-d1c7-4fa8-b27c-cab015c0036b</serial>
Nov 27 23:25:34 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:25:34 user nova-compute[75621]: </disk>
Nov 27 23:25:34 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:25:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully detached device vdc from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the persistent domain config.
Nov 27 23:25:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:25:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:25:34 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:25:34 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:25:34 user nova-compute[75621]:   <target dev="vdc" bus="virtio"/>
Nov 27 23:25:34 user nova-compute[75621]:   <serial>348ac953-d1c7-4fa8-b27c-cab015c0036b</serial>
Nov 27 23:25:34 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 27 23:25:34 user nova-compute[75621]: </disk>
Nov 27 23:25:34 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:25:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:25:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:41 user nova-compute[75621]: INFO nova.compute.manager [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Terminating instance
Nov 27 23:25:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-unplugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] No waiting events found dispatching network-vif-unplugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:41 user nova-compute[75621]: DEBUG nova.compute.manager [req-69b05f6c-0e6d-41e8-8b08-860bf8c22ce4 req-2735716a-9f0d-4a86-88ca-41c18189b69a service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-unplugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Instance destroyed successfully.
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid 6c37c104-1220-4672-a140-54a62f398b44 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:20:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1844229631',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1844229631',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtotp/meKDGmOrDGQ+X6sKVoOZgYxMA/rsqg1NCexivnceNFQvD+sq9kbTkzApvIivwtJfqKoqBXIwK90zzw6L5EJAEJ25/9+vg5SjEKVoEx6Klh0ow4YzLXGQT8pJrxQ==',key_name='tempest-keypair-854960287',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:21:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-z53wxd4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:21:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=6c37c104-1220-4672-a140-54a62f398b44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "address": "fa:16:3e:86:33:56", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf2e416b-95", "ovs_interfaceid": "bf2e416b-9558-4db6-b3c3-9f782af7a1e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_vif [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf2e416b-95, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59d1bf0f-b646-4ce1-830c-00e022035ed7) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:42 user nova-compute[75621]: INFO os_vif [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:33:56,bridge_name='br-int',has_traffic_filtering=True,id=bf2e416b-9558-4db6-b3c3-9f782af7a1e2,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf2e416b-95')
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pJKzWeOE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:42 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16f7242-3d3f-4023-88f9-f99f0a315ca4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:25:42 user nova-compute[75621]: No targets found.
Nov 27 23:25:42 user nova-compute[75621]: iSNS:
Nov 27 23:25:42 user nova-compute[75621]: No targets found.
Nov 27 23:25:42 user nova-compute[75621]: STATIC:
Nov 27 23:25:42 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10
Nov 27 23:25:42 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:25:42 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:25:42 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b
Nov 27 23:25:42 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:25:42 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:25:42 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b
Nov 27 23:25:42 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:25:42 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:25:42 user nova-compute[75621]: FIRMWARE:
Nov 27 23:25:42 user nova-compute[75621]: No targets found.
Nov 27 23:25:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:25:42 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:25:42 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd8c787-0f48-4c42-a27f-6e0c130e266d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2fab56-b6b6-44aa-8b64-2e40dd4ea572]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:42 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:42 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b (non-flash)
Nov 27 23:25:42 user nova-compute[75621]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:42 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0572290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9debb-ee23-459c-9e34-9fe850cd29a5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6139958f-e8cb-4715-9852-7d791aeedcb7]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da5732b-0d83-4849-b703-3855bf3b069f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea2293-302c-4a33-b519-5220e44f302f]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23034343161363934', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_171379d8', '/dev/disk/by-id/scsi-1SCST_BIO171379d8-0441a694f4c9f9ec') {{(pid=86804) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17194bf-f202-4a4f-8247-94fb909f0ddb]: (4, None) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82348f-35e5-4c0a-94bd-606a508de74e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce17610e-0611-47b6-b758-15eca0dd587d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260]
Nov 27 23:25:42 user nova-compute[75621]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b, portal: 172.16.0.220,3260] successful.
Nov 27 23:25:42 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c785d9e-c22a-4755-9f6d-c078df77372b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd9f29-c07c-4e4a-80e2-a96ded7416f2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (348ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:25:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Deleting instance files /opt/stack/data/nova/instances/6c37c104-1220-4672-a140-54a62f398b44_del
Nov 27 23:25:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Deletion of /opt/stack/data/nova/instances/6c37c104-1220-4672-a140-54a62f398b44_del complete
Nov 27 23:25:42 user nova-compute[75621]: INFO nova.compute.manager [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 27 23:25:42 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:25:42 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:25:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] Acquiring lock "6c37c104-1220-4672-a140-54a62f398b44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] Lock "6c37c104-1220-4672-a140-54a62f398b44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] No waiting events found dispatching network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:25:43 user nova-compute[75621]: WARNING nova.compute.manager [req-da2ea43a-0a64-4015-8193-1c6598b32bd9 req-32a89eb5-cdad-4106-ad6e-7dc551380550 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received unexpected event network-vif-plugged-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 for instance with vm_state active and task_state deleting.
Nov 27 23:25:44 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:25:44 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Took 1.42 seconds to deallocate network for instance.
Nov 27 23:25:45 user nova-compute[75621]: INFO nova.compute.manager [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Took 0.78 seconds to detach 1 volumes for instance.
Nov 27 23:25:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Deleting volume: 5c785d9e-c22a-4755-9f6d-c078df77372b {{(pid=75621) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.221s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:45 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance 6c37c104-1220-4672-a140-54a62f398b44
Nov 27 23:25:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-faaf13c0-e1d4-4e0f-a964-778e3e13d18a tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "6c37c104-1220-4672-a140-54a62f398b44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.099s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-16eaaf79-8427-4f2d-8122-2d3494dec5fd req-061ed777-0859-4f32-84c6-01433df07204 service nova] [instance: 6c37c104-1220-4672-a140-54a62f398b44] Received event network-vif-deleted-bf2e416b-9558-4db6-b3c3-9f782af7a1e2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:25:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:25:55 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a is timed out.
Nov 27 23:25:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully detached device vdc from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the live domain config.
Nov 27 23:25:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WrxLREqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:25:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6ba24-0196-47fb-ae35-e5e6193fe18c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:25:55 user nova-compute[75621]: No targets found.
Nov 27 23:25:55 user nova-compute[75621]: iSNS:
Nov 27 23:25:55 user nova-compute[75621]: No targets found.
Nov 27 23:25:55 user nova-compute[75621]: STATIC:
Nov 27 23:25:55 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10
Nov 27 23:25:55 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:25:55 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:25:55 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b
Nov 27 23:25:55 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:25:55 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:25:55 user nova-compute[75621]: FIRMWARE:
Nov 27 23:25:55 user nova-compute[75621]: No targets found.
Nov 27 23:25:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:25:55 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:25:55 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf1aa4-65c0-447d-96b4-35bfe742d4b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9f6a7e-b05f-470d-b6b7-e62d1f37c64d]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:55 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:25:55 user nova-compute[75621]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b (non-flash)
Nov 27 23:25:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05e7a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f798c5-dd65-4ac3-90c0-5e3deb9986bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2514f425-0e13-4d78-8f4d-2130df67f460]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1928897-d3c4-480b-8df5-995b2d7b2491]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26396ea-3060-4ee3-9b48-33e9c52bdf52]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e754601-c7a2-40c4-8d07-93d91ef55f9f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d452a79-9d13-4a8c-82dd-c4a7898582a5]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260]
Nov 27 23:25:55 user nova-compute[75621]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b, portal: 172.16.0.220,3260] successful.
Nov 27 23:25:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:348ac953-d1c7-4fa8-b27c-cab015c0036b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd949997-e0cc-4632-bc57-72489a74100b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== disconnect_volume: return (310ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:25:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:25:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:25:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ab20daf1-a469-480a-8fda-ee12ce728808 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.803s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:25:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:25:57 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:04 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:04 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:26:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:11 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:26:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.040260314941406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8e45e11-3732-4bf0-959e-79963cf8ac3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 9a018a62-cab5-4019-bb21-8717c226159f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:26:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.245s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:26:16 user nova-compute[75621]: INFO nova.compute.claims [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Claim successful on node user
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:26:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:26:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Creating image(s)
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "/opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "/opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "/opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG nova.policy [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e70f3785a4ab4078a213854ffc2826a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c9e17bf7f4f58a4bcd199179da537', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk 1073741824" returned: 0 in 0.067s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.204s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Cannot resize image /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Ensure instance console log exists: /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Successfully created port: 9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Successfully updated port: 9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquired lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-changed-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Refreshing instance network info cache due to event network-changed-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] Acquiring lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Updating instance_info_cache with network_info: [{"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Releasing lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Instance network_info: |[{"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] Acquired lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Refreshing network info cache for port 9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Start _get_guest_xml network_info=[{"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:26:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:26:18 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-387581221',display_name='tempest-VolumesNegativeTest-instance-387581221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-387581221',id=44,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c9e17bf7f4f58a4bcd199179da537',ramdisk_id='',reservation_id='r-805bcfaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-673419850',owner_user_name='tempest-VolumesNegativeTest-673419850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:26:16Z,user_data=None,user_id='e70f3785a4ab4078a213854ffc2826a3',uuid=cbe3eace-b734-4a65-8a1a-e44076e8d8dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converting VIF {"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lazy-loading 'pci_devices' on Instance uuid cbe3eace-b734-4a65-8a1a-e44076e8d8dc {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:26:19 user nova-compute[75621]:   <uuid>cbe3eace-b734-4a65-8a1a-e44076e8d8dc</uuid>
Nov 27 23:26:19 user nova-compute[75621]:   <name>instance-0000002c</name>
Nov 27 23:26:19 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:26:19 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:26:19 user nova-compute[75621]:   <metadata>
Nov 27 23:26:19 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:26:19 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:name>tempest-VolumesNegativeTest-instance-387581221</nova:name>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:26:18</nova:creationTime>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:26:19 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:26:19 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:owner>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:user uuid="e70f3785a4ab4078a213854ffc2826a3">tempest-VolumesNegativeTest-673419850-project-member</nova:user>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:project uuid="799c9e17bf7f4f58a4bcd199179da537">tempest-VolumesNegativeTest-673419850</nova:project>
Nov 27 23:26:19 user nova-compute[75621]:       </nova:owner>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:26:19 user nova-compute[75621]:       <nova:ports>
Nov 27 23:26:19 user nova-compute[75621]:         <nova:port uuid="9fdc2ebd-9a23-45bd-8831-64bc2cd3d854">
Nov 27 23:26:19 user nova-compute[75621]:           <nova:ip type="fixed" address="192.168.233.113" ipVersion="4"/>
Nov 27 23:26:19 user nova-compute[75621]:         </nova:port>
Nov 27 23:26:19 user nova-compute[75621]:       </nova:ports>
Nov 27 23:26:19 user nova-compute[75621]:     </nova:instance>
Nov 27 23:26:19 user nova-compute[75621]:   </metadata>
Nov 27 23:26:19 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:26:19 user nova-compute[75621]:     <system>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="serial">cbe3eace-b734-4a65-8a1a-e44076e8d8dc</entry>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="uuid">cbe3eace-b734-4a65-8a1a-e44076e8d8dc</entry>
Nov 27 23:26:19 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:26:19 user nova-compute[75621]:     </system>
Nov 27 23:26:19 user nova-compute[75621]:   </sysinfo>
Nov 27 23:26:19 user nova-compute[75621]:   <os>
Nov 27 23:26:19 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:26:19 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:26:19 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:26:19 user nova-compute[75621]:   </os>
Nov 27 23:26:19 user nova-compute[75621]:   <features>
Nov 27 23:26:19 user nova-compute[75621]:     <acpi/>
Nov 27 23:26:19 user nova-compute[75621]:     <apic/>
Nov 27 23:26:19 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:26:19 user nova-compute[75621]:   </features>
Nov 27 23:26:19 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:26:19 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:26:19 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:26:19 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:26:19 user nova-compute[75621]:   </clock>
Nov 27 23:26:19 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:26:19 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:26:19 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:26:19 user nova-compute[75621]:   </cpu>
Nov 27 23:26:19 user nova-compute[75621]:   <devices>
Nov 27 23:26:19 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:26:19 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:26:19 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk"/>
Nov 27 23:26:19 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:26:19 user nova-compute[75621]:     </disk>
Nov 27 23:26:19 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:26:19 user nova-compute[75621]:       <mac address="fa:16:3e:0e:27:13"/>
Nov 27 23:26:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:26:19 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:26:19 user nova-compute[75621]:       <target dev="tap9fdc2ebd-9a"/>
Nov 27 23:26:19 user nova-compute[75621]:     </interface>
Nov 27 23:26:19 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:26:19 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/console.log" append="off"/>
Nov 27 23:26:19 user nova-compute[75621]:     </serial>
Nov 27 23:26:19 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:26:19 user nova-compute[75621]:     <video>
Nov 27 23:26:19 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:26:19 user nova-compute[75621]:     </video>
Nov 27 23:26:19 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:26:19 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:26:19 user nova-compute[75621]:     </rng>
Nov 27 23:26:19 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:26:19 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:26:19 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:26:19 user nova-compute[75621]:     </memballoon>
Nov 27 23:26:19 user nova-compute[75621]:   </devices>
Nov 27 23:26:19 user nova-compute[75621]: </domain>
Nov 27 23:26:19 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-387581221',display_name='tempest-VolumesNegativeTest-instance-387581221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-387581221',id=44,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c9e17bf7f4f58a4bcd199179da537',ramdisk_id='',reservation_id='r-805bcfaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-673419850',owner_user_name='tempest-VolumesNegativeTest-673419850-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:26:16Z,user_data=None,user_id='e70f3785a4ab4078a213854ffc2826a3',uuid=cbe3eace-b734-4a65-8a1a-e44076e8d8dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converting VIF {"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG os_vif [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0fc54cd9-96bf-5e14-a1c3-5a5567b5ded5', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9fdc2ebd-9a, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9fdc2ebd-9a, col_values=(('qos', UUID('b56186d0-1177-45c8-b70a-ebb8d127d9ac')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9fdc2ebd-9a, col_values=(('external_ids', {'iface-id': '9fdc2ebd-9a23-45bd-8831-64bc2cd3d854', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:27:13', 'vm-uuid': 'cbe3eace-b734-4a65-8a1a-e44076e8d8dc'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:19 user nova-compute[75621]: INFO os_vif [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a')
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] No VIF found with MAC fa:16:3e:0e:27:13, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Updated VIF entry in instance network info cache for port 9fdc2ebd-9a23-45bd-8831-64bc2cd3d854. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Updating instance_info_cache with network_info: [{"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-238b9ba3-432f-4e15-9108-0a61a0c7290f req-4b2192e4-0f89-4cae-b468-23f2629d62d8 service nova] Releasing lock "refresh_cache-cbe3eace-b734-4a65-8a1a-e44076e8d8dc" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:26:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating instance_info_cache with network_info: [{"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b8e45e11-3732-4bf0-959e-79963cf8ac3a" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] No waiting events found dispatching network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:21 user nova-compute[75621]: WARNING nova.compute.manager [req-e3048670-6f57-4235-a16b-8d10cb4de754 req-817cab6b-e284-44cb-b3c0-99c9a29dc6f5 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received unexpected event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 for instance with vm_state building and task_state spawning.
Nov 27 23:26:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:26:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Instance spawned successfully.
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:22 user nova-compute[75621]: INFO nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 27 23:26:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:26:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:23 user nova-compute[75621]: DEBUG nova.compute.manager [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] No waiting events found dispatching network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:23 user nova-compute[75621]: WARNING nova.compute.manager [req-3c08fbd0-ffab-46b8-a947-6e372dcdb56a req-97ba727b-859d-47a7-95b3-c1bcb3f0068f service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received unexpected event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 for instance with vm_state building and task_state spawning.
Nov 27 23:26:23 user nova-compute[75621]: INFO nova.compute.manager [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Took 7.11 seconds to build instance.
Nov 27 23:26:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-47d6168d-1a32-47b4-8358-71faed072d3f tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.231s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:25 user nova-compute[75621]: INFO nova.compute.manager [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Detaching volume c98272ae-daf3-4b4c-915d-20021092ef10
Nov 27 23:26:25 user nova-compute[75621]: INFO nova.virt.block_device [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Attempting to driver detach volume c98272ae-daf3-4b4c-915d-20021092ef10 from mountpoint /dev/vdb
Nov 27 23:26:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Attempting to detach device vdb from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:26:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:26:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:26:25 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:26:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:26:25 user nova-compute[75621]:   <serial>c98272ae-daf3-4b4c-915d-20021092ef10</serial>
Nov 27 23:26:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:26:25 user nova-compute[75621]: </disk>
Nov 27 23:26:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:26:25 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully detached device vdb from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the persistent domain config.
Nov 27 23:26:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:26:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:26:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:26:25 user nova-compute[75621]:   <source dev="/dev/sdc"/>
Nov 27 23:26:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:26:25 user nova-compute[75621]:   <serial>c98272ae-daf3-4b4c-915d-20021092ef10</serial>
Nov 27 23:26:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:26:25 user nova-compute[75621]: </disk>
Nov 27 23:26:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:26:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:26:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:26:43 user nova-compute[75621]: INFO nova.compute.claims [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Claim successful on node user
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:26:43 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG nova.policy [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:26:43 user nova-compute[75621]: INFO nova.virt.block_device [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Booting with volume 2d8c4141-da96-49d0-b650-88647ef8e5e7 at /dev/vda
Nov 27 23:26:43 user nova-compute[75621]: DEBUG os_brick.utils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:26:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[64534b48-1b2c-400d-8bda-b02f2411fab4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d56bc7-2e1c-4819-a63b-d1c23bf6e80c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d302da42-6912-400f-85ed-5d12c79153e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34cb810-43b8-4b69-b276-c3274e0457b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:26:44 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:26:44 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[64521ead-105d-42a7-91be-3c9845599dc8]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG os_brick.utils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating existing volume attachment record: 98526b02-ac1a-4b00-bf9d-a9f4e9718357 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Successfully created port: 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Successfully updated port: 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-changed-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Refreshing instance network info cache due to event network-changed-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] Acquiring lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.network.neutron [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Instance network_info: |[{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] Acquired lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.network.neutron [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Refreshing network info cache for port 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:26:45 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a is timed out.
Nov 27 23:26:45 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully detached device vdb from instance b8e45e11-3732-4bf0-959e-79963cf8ac3a from the live domain config.
Nov 27 23:26:45 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxQgJGbe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:26:45 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5467fa-d69b-45c2-b8b0-27877f8ecc9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:26:45 user nova-compute[75621]: No targets found.
Nov 27 23:26:45 user nova-compute[75621]: iSNS:
Nov 27 23:26:45 user nova-compute[75621]: No targets found.
Nov 27 23:26:45 user nova-compute[75621]: STATIC:
Nov 27 23:26:45 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10
Nov 27 23:26:45 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:26:45 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:26:45 user nova-compute[75621]: FIRMWARE:
Nov 27 23:26:45 user nova-compute[75621]: No targets found.
Nov 27 23:26:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:26:45 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:26:45 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6bd68d-e09d-4eb6-8240-bc5211f6ebc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3133b617-c877-415f-9b20-b3d3e7503fb1]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:26:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 (non-flash)
Nov 27 23:26:45 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05e4040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9120a98-1e38-472f-9b1d-03612b52c904]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5802c6-6ea1-4baf-a0da-3babbffe3463]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c219d28-b8ea-4a60-b976-aa37c5e73631]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:26:45 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87398ea8-2746-4fea-870d-7c512b52164c]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f487b09-f4cb-4153-9250-3b69ae69b3f2]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[da063b7b-9202-4a75-98c6-0c4de79651e4]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260]
Nov 27 23:26:46 user nova-compute[75621]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10, portal: 172.16.0.220,3260] successful.
Nov 27 23:26:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c98272ae-daf3-4b4c-915d-20021092ef10 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6356bb0-cf43-41c6-b600-3331fb8ab107]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] <== disconnect_volume: return (319ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updated VIF entry in instance network info cache for port 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-6ad19422-60ed-492d-9624-85ae5b66730f req-ea8870e1-a610-4b91-acd2-34e6a2e1e442 service nova] Releasing lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'flavor' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5ec55259-398a-404d-85a5-8cdd043d3929 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:47 user nova-compute[75621]: INFO nova.compute.manager [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Terminating instance
Nov 27 23:26:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-unplugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] No waiting events found dispatching network-vif-unplugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-3556975d-a6f8-48a6-be05-8eebe5002b34 req-d2ba7ede-39eb-4100-8e8a-8908210e783c service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-unplugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Instance destroyed successfully.
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lazy-loading 'resources' on Instance uuid 9a018a62-cab5-4019-bb21-8717c226159f {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:24:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1644945194',display_name='tempest-VolumesActionsTest-instance-1644945194',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1644945194',id=43,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='225ed56580174c82872d16a37c20b84a',ramdisk_id='',reservation_id='r-txpsizbh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-89555776',owner_user_name='tempest-VolumesActionsTest-89555776-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:25:03Z,user_data=None,user_id='8063d26e4982455497e74bf4234831c3',uuid=9a018a62-cab5-4019-bb21-8717c226159f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converting VIF {"id": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "address": "fa:16:3e:b8:39:5d", "network": {"id": "0045d0e7-ff3a-4246-ab30-0486e438638f", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861324238-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "225ed56580174c82872d16a37c20b84a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ed6aafa-b3", "ovs_interfaceid": "2ed6aafa-b377-4003-a9fd-19ef0a336b1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG os_vif [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ed6aafa-b3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=abe1ea20-ea4d-46bc-ac9b-93dd592bc1ee) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:48 user nova-compute[75621]: INFO os_vif [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:39:5d,bridge_name='br-int',has_traffic_filtering=True,id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d,network=Network(0045d0e7-ff3a-4246-ab30-0486e438638f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ed6aafa-b3')
Nov 27 23:26:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Deleting instance files /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f_del
Nov 27 23:26:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Deletion of /opt/stack/data/nova/instances/9a018a62-cab5-4019-bb21-8717c226159f_del complete
Nov 27 23:26:48 user nova-compute[75621]: INFO nova.compute.manager [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 27 23:26:48 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:26:48 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-b46b1b6e-ba98-4fd8-975d-dd0fcd66d059 req-ede18eb3-d60e-4e5d-8217-574bdb22891b service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-deleted-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:49 user nova-compute[75621]: INFO nova.compute.manager [req-b46b1b6e-ba98-4fd8-975d-dd0fcd66d059 req-ede18eb3-d60e-4e5d-8217-574bdb22891b service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Neutron deleted interface 2ed6aafa-b377-4003-a9fd-19ef0a336b1d; detaching it from the instance and deleting it from the info cache
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.network.neutron [req-b46b1b6e-ba98-4fd8-975d-dd0fcd66d059 req-ede18eb3-d60e-4e5d-8217-574bdb22891b service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:26:49 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Took 0.47 seconds to deallocate network for instance.
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-b46b1b6e-ba98-4fd8-975d-dd0fcd66d059 req-ede18eb3-d60e-4e5d-8217-574bdb22891b service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Detach interface failed, port_id=2ed6aafa-b377-4003-a9fd-19ef0a336b1d, reason: Instance 9a018a62-cab5-4019-bb21-8717c226159f could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.243s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:49 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Deleted allocations for instance 9a018a62-cab5-4019-bb21-8717c226159f
Nov 27 23:26:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cc55de01-fef2-4441-9e50-eb3ac0c328ca tempest-VolumesActionsTest-89555776 tempest-VolumesActionsTest-89555776-project-member] Lock "9a018a62-cab5-4019-bb21-8717c226159f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.894s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] Acquiring lock "9a018a62-cab5-4019-bb21-8717c226159f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] Lock "9a018a62-cab5-4019-bb21-8717c226159f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:50 user nova-compute[75621]: DEBUG nova.compute.manager [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] No waiting events found dispatching network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:50 user nova-compute[75621]: WARNING nova.compute.manager [req-7a4bd507-8453-45c1-9f87-bee28a49270c req-d03fb029-fadd-47ae-8332-2345992ed8b5 service nova] [instance: 9a018a62-cab5-4019-bb21-8717c226159f] Received unexpected event network-vif-plugged-2ed6aafa-b377-4003-a9fd-19ef0a336b1d for instance with vm_state deleted and task_state None.
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:26:51 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Creating image(s)
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Ensure instance console log exists: /opt/stack/data/nova/instances/b70307e5-1672-437f-b582-79dea07c372c/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Start _get_guest_xml network_info=[{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '98526b02-ac1a-4b00-bf9d-a9f4e9718357', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b70307e5-1672-437f-b582-79dea07c372c', 'attached_at': '', 'detached_at': '', 'volume_id': '2d8c4141-da96-49d0-b650-88647ef8e5e7', 'serial': '2d8c4141-da96-49d0-b650-88647ef8e5e7'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:26:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:51 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:26:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:26:51 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:26:51 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c7767-db35-475b-8748-bce3a3c1d819]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:26:51 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a8e224-4af3-487d-8365-8af8a3a049be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7] added
Nov 27 23:26:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c431e0d-10dc-44a9-9038-3c3a75dca361]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[018f088d-6015-434c-b652-acc8863a66d5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFJnmrGx {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFJnmrGx" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b980a97e-4871-42d5-b852-ef2b23f435f9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFJnmrGx'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[325b2a4f-504b-4984-a03a-c25e30fb6e08]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1ae359-6cc0-4fc0-a219-54297cfe9566]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:26:52 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:26:52 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:26:52 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:26:52 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:26:52 user nova-compute[75621]: 
Nov 27 23:26:52 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --login" returned: 0 in 1.054s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9e741a-c1d0-4cea-ad07-a835cd7e9ae0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]
Nov 27 23:26:53 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.
Nov 27 23:26:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9c6445-c7f6-4dca-b350-cb9c9a1ef2e6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb00b03-9c02-41a7-99ff-2dc7d6f14f23]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:26:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:26:53 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.301s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7def38-8dfc-4d5a-ba0f-fa2ddc1be736]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:26:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.331s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (2333ms) {'type': 'block', 'scsi_wwn': '26366663462393937', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663462393937', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187562876',display_name='tempest-TestVolumeBootPattern-server-1187562876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187562876',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-x8t0qq6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:26:44Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=b70307e5-1672-437f-b582-79dea07c372c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid b70307e5-1672-437f-b582-79dea07c372c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:26:54 user nova-compute[75621]:   <uuid>b70307e5-1672-437f-b582-79dea07c372c</uuid>
Nov 27 23:26:54 user nova-compute[75621]:   <name>instance-0000002d</name>
Nov 27 23:26:54 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:26:54 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:26:54 user nova-compute[75621]:   <metadata>
Nov 27 23:26:54 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:26:54 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:26:54 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-server-1187562876</nova:name>
Nov 27 23:26:54 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:26:51</nova:creationTime>
Nov 27 23:26:54 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:26:54 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:26:54 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:26:54 user nova-compute[75621]:       <nova:owner>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:26:54 user nova-compute[75621]:       </nova:owner>
Nov 27 23:26:54 user nova-compute[75621]:       <nova:ports>
Nov 27 23:26:54 user nova-compute[75621]:         <nova:port uuid="69f0fe5a-975b-40b3-8f98-43e2b7e80b4f">
Nov 27 23:26:54 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:26:54 user nova-compute[75621]:         </nova:port>
Nov 27 23:26:54 user nova-compute[75621]:       </nova:ports>
Nov 27 23:26:54 user nova-compute[75621]:     </nova:instance>
Nov 27 23:26:54 user nova-compute[75621]:   </metadata>
Nov 27 23:26:54 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:26:54 user nova-compute[75621]:     <system>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="serial">b70307e5-1672-437f-b582-79dea07c372c</entry>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="uuid">b70307e5-1672-437f-b582-79dea07c372c</entry>
Nov 27 23:26:54 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:26:54 user nova-compute[75621]:     </system>
Nov 27 23:26:54 user nova-compute[75621]:   </sysinfo>
Nov 27 23:26:54 user nova-compute[75621]:   <os>
Nov 27 23:26:54 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:26:54 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:26:54 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:26:54 user nova-compute[75621]:   </os>
Nov 27 23:26:54 user nova-compute[75621]:   <features>
Nov 27 23:26:54 user nova-compute[75621]:     <acpi/>
Nov 27 23:26:54 user nova-compute[75621]:     <apic/>
Nov 27 23:26:54 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:26:54 user nova-compute[75621]:   </features>
Nov 27 23:26:54 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:26:54 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:26:54 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:26:54 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:26:54 user nova-compute[75621]:   </clock>
Nov 27 23:26:54 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:26:54 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:26:54 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:26:54 user nova-compute[75621]:   </cpu>
Nov 27 23:26:54 user nova-compute[75621]:   <devices>
Nov 27 23:26:54 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:26:54 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:26:54 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:26:54 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:26:54 user nova-compute[75621]:       <serial>2d8c4141-da96-49d0-b650-88647ef8e5e7</serial>
Nov 27 23:26:54 user nova-compute[75621]:     </disk>
Nov 27 23:26:54 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:26:54 user nova-compute[75621]:       <mac address="fa:16:3e:f4:84:3b"/>
Nov 27 23:26:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:26:54 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:26:54 user nova-compute[75621]:       <target dev="tap69f0fe5a-97"/>
Nov 27 23:26:54 user nova-compute[75621]:     </interface>
Nov 27 23:26:54 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:26:54 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/b70307e5-1672-437f-b582-79dea07c372c/console.log" append="off"/>
Nov 27 23:26:54 user nova-compute[75621]:     </serial>
Nov 27 23:26:54 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:26:54 user nova-compute[75621]:     <video>
Nov 27 23:26:54 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:26:54 user nova-compute[75621]:     </video>
Nov 27 23:26:54 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:26:54 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:26:54 user nova-compute[75621]:     </rng>
Nov 27 23:26:54 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:26:54 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:26:54 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:26:54 user nova-compute[75621]:     </memballoon>
Nov 27 23:26:54 user nova-compute[75621]:   </devices>
Nov 27 23:26:54 user nova-compute[75621]: </domain>
Nov 27 23:26:54 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187562876',display_name='tempest-TestVolumeBootPattern-server-1187562876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187562876',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-x8t0qq6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:26:44Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=b70307e5-1672-437f-b582-79dea07c372c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG os_vif [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51c3f21c-2760-578e-a523-6a557a9d668d', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69f0fe5a-97, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69f0fe5a-97, col_values=(('qos', UUID('00030496-6d73-475a-bd02-adbf3ea8a4de')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69f0fe5a-97, col_values=(('external_ids', {'iface-id': '69f0fe5a-975b-40b3-8f98-43e2b7e80b4f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:84:3b', 'vm-uuid': 'b70307e5-1672-437f-b582-79dea07c372c'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:54 user nova-compute[75621]: INFO os_vif [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97')
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:f4:84:3b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:26:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:55 user nova-compute[75621]: DEBUG nova.compute.manager [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] No waiting events found dispatching network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:55 user nova-compute[75621]: WARNING nova.compute.manager [req-acfcddd0-263f-4bc8-af3b-f95df463b6c1 req-129edced-d8c0-42e3-ad0f-2bca49bf4d66 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received unexpected event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f for instance with vm_state building and task_state spawning.
Nov 27 23:26:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:26:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:26:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:26:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] No waiting events found dispatching network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:26:57 user nova-compute[75621]: WARNING nova.compute.manager [req-76deebb7-1da0-4ef0-89b4-b9efbdc8cb85 req-9e94a662-ee25-4b73-8497-834cb8efa041 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received unexpected event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f for instance with vm_state building and task_state spawning.
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:26:58 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] Instance spawned successfully.
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:26:58 user nova-compute[75621]: INFO nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Took 6.33 seconds to spawn the instance on the hypervisor.
Nov 27 23:26:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:26:58 user nova-compute[75621]: INFO nova.compute.manager [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Took 14.84 seconds to build instance.
Nov 27 23:26:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-e433a6e0-55ca-4a4b-a759-7af1bf7b7354 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.940s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:26:58 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:26:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:26:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:06 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:27:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:27:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.017444610595703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b8e45e11-3732-4bf0-959e-79963cf8ac3a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance cbe3eace-b734-4a65-8a1a-e44076e8d8dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b70307e5-1672-437f-b582-79dea07c372c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 97183148-efe1-4da2-9fd3-da793c15eaea has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.275s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:14 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:27:14 user nova-compute[75621]: INFO nova.compute.claims [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Claim successful on node user
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:27:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.policy [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69bb978f984e4b6eac393c6d879d5f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8803295cb17944c5b2457facfbbbf5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:27:15 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Creating image(s)
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "/opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "/opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "/opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:15 user nova-compute[75621]: INFO nova.compute.manager [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Terminating instance
Nov 27 23:27:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk 1073741824" returned: 0 in 0.071s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-unplugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] No waiting events found dispatching network-vif-unplugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-cffaf39f-44d6-4447-8f8e-d374d7730f1e req-0947676b-652c-4f88-b101-41cc562c3e49 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-unplugged-120638fa-e253-4877-b65a-4d918b0a7e3a for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.209s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Successfully created port: 4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Cannot resize image /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Ensure instance console log exists: /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Instance destroyed successfully.
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.objects.instance [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lazy-loading 'resources' on Instance uuid b8e45e11-3732-4bf0-959e-79963cf8ac3a {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:23:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1914719192',display_name='tempest-TestServerVolumeAttachmentScenario-server-1914719192',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1914719192',id=42,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGN9VmsWsPc8tEEoiX5ILBFSVIXkSwElHaX4yxWAZpqZ4Yra7uPZiEACgKnyOb9g2eA2aHKBZZq5Hnf6bkJtUAutJCAyeIy7yJs5w2tNjEqcYFbjtutpIRJcOB8iFY8MtA==',key_name='tempest-keypair-1309957419',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:23:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a6b701eedff4276b638269324422bc3',ramdisk_id='',reservation_id='r-pp05ewmh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1147127762',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1147127762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:23:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='626e3f11835549ee9a3765319d7fe55b',uuid=b8e45e11-3732-4bf0-959e-79963cf8ac3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converting VIF {"id": "120638fa-e253-4877-b65a-4d918b0a7e3a", "address": "fa:16:3e:e6:60:a3", "network": {"id": "d809b631-84bd-4599-b332-31ff1749b9be", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1537439557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a6b701eedff4276b638269324422bc3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap120638fa-e2", "ovs_interfaceid": "120638fa-e253-4877-b65a-4d918b0a7e3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG os_vif [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap120638fa-e2, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b097286-b985-4f79-8087-fadd14b8b0f1) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:27:16 user nova-compute[75621]: INFO os_vif [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:60:a3,bridge_name='br-int',has_traffic_filtering=True,id=120638fa-e253-4877-b65a-4d918b0a7e3a,network=Network(d809b631-84bd-4599-b332-31ff1749b9be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap120638fa-e2')
Nov 27 23:27:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Deleting instance files /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a_del
Nov 27 23:27:16 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Deletion of /opt/stack/data/nova/instances/b8e45e11-3732-4bf0-959e-79963cf8ac3a_del complete
Nov 27 23:27:16 user nova-compute[75621]: INFO nova.compute.manager [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Successfully updated port: 4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquired lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-changed-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG nova.compute.manager [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Refreshing instance network info cache due to event network-changed-4a2bb9d8-9d8b-4291-807d-df31b1984307. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:27:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] Acquiring lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating instance_info_cache with network_info: [{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Releasing lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Instance network_info: |[{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] Acquired lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Refreshing network info cache for port 4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Start _get_guest_xml network_info=[{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:27:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:27:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041501852',display_name='tempest-VolumesSnapshotTestJSON-instance-1041501852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041501852',id=46,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqt7fg4pgGCHmfjaOCudOVqK6Mq5ft4BNyPSIr8ThwJeLUXbuTbr2mOLQVH3sCmpJKjMhX2eaGY8JyRIaQojBxGmZ6+4uk/7es0oPHpD/HucUs8oUJDAulbPMOQ/ucQg==',key_name='tempest-keypair-1275502151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-0akqja9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=97183148-efe1-4da2-9fd3-da793c15eaea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.objects.instance [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'pci_devices' on Instance uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:27:17 user nova-compute[75621]:   <uuid>97183148-efe1-4da2-9fd3-da793c15eaea</uuid>
Nov 27 23:27:17 user nova-compute[75621]:   <name>instance-0000002e</name>
Nov 27 23:27:17 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:27:17 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:27:17 user nova-compute[75621]:   <metadata>
Nov 27 23:27:17 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:27:17 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1041501852</nova:name>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:27:17</nova:creationTime>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:27:17 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:27:17 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:owner>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:user uuid="69bb978f984e4b6eac393c6d879d5f20">tempest-VolumesSnapshotTestJSON-1370947947-project-member</nova:user>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:project uuid="8803295cb17944c5b2457facfbbbf5fd">tempest-VolumesSnapshotTestJSON-1370947947</nova:project>
Nov 27 23:27:17 user nova-compute[75621]:       </nova:owner>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:27:17 user nova-compute[75621]:       <nova:ports>
Nov 27 23:27:17 user nova-compute[75621]:         <nova:port uuid="4a2bb9d8-9d8b-4291-807d-df31b1984307">
Nov 27 23:27:17 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 27 23:27:17 user nova-compute[75621]:         </nova:port>
Nov 27 23:27:17 user nova-compute[75621]:       </nova:ports>
Nov 27 23:27:17 user nova-compute[75621]:     </nova:instance>
Nov 27 23:27:17 user nova-compute[75621]:   </metadata>
Nov 27 23:27:17 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:27:17 user nova-compute[75621]:     <system>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="serial">97183148-efe1-4da2-9fd3-da793c15eaea</entry>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="uuid">97183148-efe1-4da2-9fd3-da793c15eaea</entry>
Nov 27 23:27:17 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:27:17 user nova-compute[75621]:     </system>
Nov 27 23:27:17 user nova-compute[75621]:   </sysinfo>
Nov 27 23:27:17 user nova-compute[75621]:   <os>
Nov 27 23:27:17 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:27:17 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:27:17 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:27:17 user nova-compute[75621]:   </os>
Nov 27 23:27:17 user nova-compute[75621]:   <features>
Nov 27 23:27:17 user nova-compute[75621]:     <acpi/>
Nov 27 23:27:17 user nova-compute[75621]:     <apic/>
Nov 27 23:27:17 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:27:17 user nova-compute[75621]:   </features>
Nov 27 23:27:17 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:27:17 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:27:17 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:27:17 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:27:17 user nova-compute[75621]:   </clock>
Nov 27 23:27:17 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:27:17 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:27:17 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:27:17 user nova-compute[75621]:   </cpu>
Nov 27 23:27:17 user nova-compute[75621]:   <devices>
Nov 27 23:27:17 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:27:17 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:27:17 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk"/>
Nov 27 23:27:17 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:27:17 user nova-compute[75621]:     </disk>
Nov 27 23:27:17 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:27:17 user nova-compute[75621]:       <mac address="fa:16:3e:d0:6d:b4"/>
Nov 27 23:27:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:27:17 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:27:17 user nova-compute[75621]:       <target dev="tap4a2bb9d8-9d"/>
Nov 27 23:27:17 user nova-compute[75621]:     </interface>
Nov 27 23:27:17 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:27:17 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/console.log" append="off"/>
Nov 27 23:27:17 user nova-compute[75621]:     </serial>
Nov 27 23:27:17 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:27:17 user nova-compute[75621]:     <video>
Nov 27 23:27:17 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:27:17 user nova-compute[75621]:     </video>
Nov 27 23:27:17 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:27:17 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:27:17 user nova-compute[75621]:     </rng>
Nov 27 23:27:17 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:27:17 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:27:17 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:27:17 user nova-compute[75621]:     </memballoon>
Nov 27 23:27:17 user nova-compute[75621]:   </devices>
Nov 27 23:27:17 user nova-compute[75621]: </domain>
Nov 27 23:27:17 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041501852',display_name='tempest-VolumesSnapshotTestJSON-instance-1041501852',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041501852',id=46,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqt7fg4pgGCHmfjaOCudOVqK6Mq5ft4BNyPSIr8ThwJeLUXbuTbr2mOLQVH3sCmpJKjMhX2eaGY8JyRIaQojBxGmZ6+4uk/7es0oPHpD/HucUs8oUJDAulbPMOQ/ucQg==',key_name='tempest-keypair-1275502151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-0akqja9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:27:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=97183148-efe1-4da2-9fd3-da793c15eaea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG os_vif [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da210f61-dc19-56db-a1bc-f06df5631973', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a2bb9d8-9d, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4a2bb9d8-9d, col_values=(('qos', UUID('e623d2af-d743-45c2-b5be-da484f60953e')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4a2bb9d8-9d, col_values=(('external_ids', {'iface-id': '4a2bb9d8-9d8b-4291-807d-df31b1984307', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:6d:b4', 'vm-uuid': '97183148-efe1-4da2-9fd3-da793c15eaea'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:27:17 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Took 0.98 seconds to deallocate network for instance.
Nov 27 23:27:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:17 user nova-compute[75621]: INFO os_vif [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d')
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No VIF found with MAC fa:16:3e:d0:6d:b4, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.compute.manager [req-5c1aafd9-9e03-4a20-b0b2-56280017efd7 req-355a8c10-39fb-4215-96a2-9546413cc5fb service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-deleted-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updated VIF entry in instance network info cache for port 4a2bb9d8-9d8b-4291-807d-df31b1984307. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.network.neutron [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating instance_info_cache with network_info: [{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:27:17 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Deleted allocations for instance b8e45e11-3732-4bf0-959e-79963cf8ac3a
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-9622fce3-67f8-451e-981a-74041e4f5a5e req-dd243b01-70b9-4f10-a261-4424cfba9d1f service nova] Releasing lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:27:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-ec6fb5c0-9dbc-48c6-b6c5-35d38e6ca8f9 tempest-TestServerVolumeAttachmentScenario-1147127762 tempest-TestServerVolumeAttachmentScenario-1147127762-project-member] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.339s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] Acquiring lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] Lock "b8e45e11-3732-4bf0-959e-79963cf8ac3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] No waiting events found dispatching network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:27:18 user nova-compute[75621]: WARNING nova.compute.manager [req-ce37e46f-1159-4e72-952a-ac328992532c req-a3cb5ff7-91f0-4937-b6de-319409f7b3c4 service nova] [instance: b8e45e11-3732-4bf0-959e-79963cf8ac3a] Received unexpected event network-vif-plugged-120638fa-e253-4877-b65a-4d918b0a7e3a for instance with vm_state deleted and task_state None.
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] No waiting events found dispatching network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:27:19 user nova-compute[75621]: WARNING nova.compute.manager [req-d8368f21-ce6d-468b-b74d-d14f0d67485e req-5e4ceba6-4df7-4279-a8be-d3c37cea0b18 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received unexpected event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 for instance with vm_state building and task_state spawning.
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:27:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] No waiting events found dispatching network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:27:21 user nova-compute[75621]: WARNING nova.compute.manager [req-87a42b2c-c8bf-4446-8c80-a066f3d5beeb req-c9347e23-cd08-4385-b08b-0ce773ae28e0 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received unexpected event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 for instance with vm_state building and task_state spawning.
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:27:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Instance spawned successfully.
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:27:21 user nova-compute[75621]: INFO nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Took 6.17 seconds to spawn the instance on the hypervisor.
Nov 27 23:27:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:27:21 user nova-compute[75621]: INFO nova.compute.manager [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Took 7.31 seconds to build instance.
Nov 27 23:27:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-282488d5-6a81-48e3-9304-95b3ad7389cb tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.418s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:27:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:27:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:27:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:27:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid cbe3eace-b734-4a65-8a1a-e44076e8d8dc {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid b70307e5-1672-437f-b582-79dea07c372c {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b70307e5-1672-437f-b582-79dea07c372c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "b70307e5-1672-437f-b582-79dea07c372c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:06 user nova-compute[75621]: INFO nova.compute.manager [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Terminating instance
Nov 27 23:28:06 user nova-compute[75621]: DEBUG nova.compute.manager [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-unplugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] No waiting events found dispatching network-vif-unplugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.compute.manager [req-aea1b2ad-707f-4e94-b494-5bf3fa422524 req-6daa38ab-47db-48e1-b992-027554168a64 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-unplugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:28:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Instance destroyed successfully.
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.objects.instance [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lazy-loading 'resources' on Instance uuid cbe3eace-b734-4a65-8a1a-e44076e8d8dc {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-387581221',display_name='tempest-VolumesNegativeTest-instance-387581221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-387581221',id=44,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:26:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c9e17bf7f4f58a4bcd199179da537',ramdisk_id='',reservation_id='r-805bcfaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-673419850',owner_user_name='tempest-VolumesNegativeTest-673419850-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:26:23Z,user_data=None,user_id='e70f3785a4ab4078a213854ffc2826a3',uuid=cbe3eace-b734-4a65-8a1a-e44076e8d8dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converting VIF {"id": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "address": "fa:16:3e:0e:27:13", "network": {"id": "f00e2faf-5b0b-461e-ac26-f96f138308f2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.113", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c56d2cf12ea4cb7b55bba91a5f6a5a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9fdc2ebd-9a", "ovs_interfaceid": "9fdc2ebd-9a23-45bd-8831-64bc2cd3d854", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG os_vif [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9fdc2ebd-9a, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b56186d0-1177-45c8-b70a-ebb8d127d9ac) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:28:07 user nova-compute[75621]: INFO os_vif [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:27:13,bridge_name='br-int',has_traffic_filtering=True,id=9fdc2ebd-9a23-45bd-8831-64bc2cd3d854,network=Network(f00e2faf-5b0b-461e-ac26-f96f138308f2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9fdc2ebd-9a')
Nov 27 23:28:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Deleting instance files /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc_del
Nov 27 23:28:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Deletion of /opt/stack/data/nova/instances/cbe3eace-b734-4a65-8a1a-e44076e8d8dc_del complete
Nov 27 23:28:07 user nova-compute[75621]: INFO nova.compute.manager [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 23:28:07 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:28:07 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:08 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Took 0.59 seconds to deallocate network for instance.
Nov 27 23:28:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG nova.compute.manager [req-59f5cbde-f15a-479b-b7a3-195aea621851 req-6bd5d7d1-21e2-44dc-904b-4846cd38d78b service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-deleted-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.166s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:08 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Deleted allocations for instance cbe3eace-b734-4a65-8a1a-e44076e8d8dc
Nov 27 23:28:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-9d6361d0-0952-4bc8-94bc-bbffa6232c42 tempest-VolumesNegativeTest-673419850 tempest-VolumesNegativeTest-673419850-project-member] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.882s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:08 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] Acquiring lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] Lock "cbe3eace-b734-4a65-8a1a-e44076e8d8dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] No waiting events found dispatching network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:09 user nova-compute[75621]: WARNING nova.compute.manager [req-28f6e168-06bd-4b3a-9a22-9afcd16eaabd req-449acbe0-cc44-4600-9103-7a12f49f13e2 service nova] [instance: cbe3eace-b734-4a65-8a1a-e44076e8d8dc] Received unexpected event network-vif-plugged-9fdc2ebd-9a23-45bd-8831-64bc2cd3d854 for instance with vm_state deleted and task_state None.
Nov 27 23:28:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:28:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:28:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:28:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8729MB free_disk=25.042095184326172GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance b70307e5-1672-437f-b582-79dea07c372c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 97183148-efe1-4da2-9fd3-da793c15eaea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b70307e5-1672-437f-b582-79dea07c372c] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid b70307e5-1672-437f-b582-79dea07c372c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:28:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:28:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:28:32 user nova-compute[75621]: INFO nova.compute.claims [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Claim successful on node user
Nov 27 23:28:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:28:32 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:28:32 user nova-compute[75621]: DEBUG nova.policy [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b45cfa90af449cd8ce3fd9bd36dbec2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff63f129421545debc5d467733803dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:28:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Creating image(s)
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "/opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "/opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.194s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk 1073741824" returned: 0 in 0.046s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Successfully created port: e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Cannot resize image /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Ensure instance console log exists: /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Successfully updated port: e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquired lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-changed-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Refreshing instance network info cache due to event network-changed-e74fc736-ab01-4c17-8e46-9d9be99933c2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] Acquiring lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating instance_info_cache with network_info: [{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Releasing lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Instance network_info: |[{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] Acquired lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Refreshing network info cache for port e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Start _get_guest_xml network_info=[{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:28:34 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:28:34 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1582993',id=47,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHopEhhGaWX7PhhQ/S5RhdjzBPpCiJ6HZDULn/TjS2Ca4VcMnG0SuODhpD1DO7stzFnpWv1M1tm6P+l1zkNYG7XSln5JmXAcDgNEj5oDobEErAn8glf0YiKsJ+oKri4dug==',key_name='tempest-keypair-1180736784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff63f129421545debc5d467733803dd0',ramdisk_id='',reservation_id='r-nnjzf148',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b45cfa90af449cd8ce3fd9bd36dbec2',uuid=1d1aba93-17a1-4c66-8a23-b3f6f694b970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converting VIF {"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:28:34 user nova-compute[75621]:   <uuid>1d1aba93-17a1-4c66-8a23-b3f6f694b970</uuid>
Nov 27 23:28:34 user nova-compute[75621]:   <name>instance-0000002f</name>
Nov 27 23:28:34 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:28:34 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:28:34 user nova-compute[75621]:   <metadata>
Nov 27 23:28:34 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:28:34 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687</nova:name>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:28:34</nova:creationTime>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:28:34 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:28:34 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:owner>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:user uuid="3b45cfa90af449cd8ce3fd9bd36dbec2">tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member</nova:user>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:project uuid="ff63f129421545debc5d467733803dd0">tempest-TestServerVolumeAttachScenarioOldVersion-2114358727</nova:project>
Nov 27 23:28:34 user nova-compute[75621]:       </nova:owner>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:28:34 user nova-compute[75621]:       <nova:ports>
Nov 27 23:28:34 user nova-compute[75621]:         <nova:port uuid="e74fc736-ab01-4c17-8e46-9d9be99933c2">
Nov 27 23:28:34 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:28:34 user nova-compute[75621]:         </nova:port>
Nov 27 23:28:34 user nova-compute[75621]:       </nova:ports>
Nov 27 23:28:34 user nova-compute[75621]:     </nova:instance>
Nov 27 23:28:34 user nova-compute[75621]:   </metadata>
Nov 27 23:28:34 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:28:34 user nova-compute[75621]:     <system>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="serial">1d1aba93-17a1-4c66-8a23-b3f6f694b970</entry>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="uuid">1d1aba93-17a1-4c66-8a23-b3f6f694b970</entry>
Nov 27 23:28:34 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:28:34 user nova-compute[75621]:     </system>
Nov 27 23:28:34 user nova-compute[75621]:   </sysinfo>
Nov 27 23:28:34 user nova-compute[75621]:   <os>
Nov 27 23:28:34 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:28:34 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:28:34 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:28:34 user nova-compute[75621]:   </os>
Nov 27 23:28:34 user nova-compute[75621]:   <features>
Nov 27 23:28:34 user nova-compute[75621]:     <acpi/>
Nov 27 23:28:34 user nova-compute[75621]:     <apic/>
Nov 27 23:28:34 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:28:34 user nova-compute[75621]:   </features>
Nov 27 23:28:34 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:28:34 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:28:34 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:28:34 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:28:34 user nova-compute[75621]:   </clock>
Nov 27 23:28:34 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:28:34 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:28:34 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:28:34 user nova-compute[75621]:   </cpu>
Nov 27 23:28:34 user nova-compute[75621]:   <devices>
Nov 27 23:28:34 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:28:34 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:28:34 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk"/>
Nov 27 23:28:34 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:28:34 user nova-compute[75621]:     </disk>
Nov 27 23:28:34 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:28:34 user nova-compute[75621]:       <mac address="fa:16:3e:b0:eb:eb"/>
Nov 27 23:28:34 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:28:34 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:28:34 user nova-compute[75621]:       <target dev="tape74fc736-ab"/>
Nov 27 23:28:34 user nova-compute[75621]:     </interface>
Nov 27 23:28:34 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:28:34 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/console.log" append="off"/>
Nov 27 23:28:34 user nova-compute[75621]:     </serial>
Nov 27 23:28:34 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:28:34 user nova-compute[75621]:     <video>
Nov 27 23:28:34 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:28:34 user nova-compute[75621]:     </video>
Nov 27 23:28:34 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:28:34 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:28:34 user nova-compute[75621]:     </rng>
Nov 27 23:28:34 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:28:34 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:28:34 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:28:34 user nova-compute[75621]:     </memballoon>
Nov 27 23:28:34 user nova-compute[75621]:   </devices>
Nov 27 23:28:34 user nova-compute[75621]: </domain>
Nov 27 23:28:34 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1582993',id=47,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHopEhhGaWX7PhhQ/S5RhdjzBPpCiJ6HZDULn/TjS2Ca4VcMnG0SuODhpD1DO7stzFnpWv1M1tm6P+l1zkNYG7XSln5JmXAcDgNEj5oDobEErAn8glf0YiKsJ+oKri4dug==',key_name='tempest-keypair-1180736784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff63f129421545debc5d467733803dd0',ramdisk_id='',reservation_id='r-nnjzf148',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:28:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b45cfa90af449cd8ce3fd9bd36dbec2',uuid=1d1aba93-17a1-4c66-8a23-b3f6f694b970,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converting VIF {"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG os_vif [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'acadb455-d408-5101-a1ff-62eba3ec30ad', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape74fc736-ab, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape74fc736-ab, col_values=(('qos', UUID('1bac9d88-fa7e-421d-b030-c38113271ed9')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape74fc736-ab, col_values=(('external_ids', {'iface-id': 'e74fc736-ab01-4c17-8e46-9d9be99933c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:eb:eb', 'vm-uuid': '1d1aba93-17a1-4c66-8a23-b3f6f694b970'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:34 user nova-compute[75621]: INFO os_vif [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab')
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] No VIF found with MAC fa:16:3e:b0:eb:eb, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updated VIF entry in instance network info cache for port e74fc736-ab01-4c17-8e46-9d9be99933c2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:28:34 user nova-compute[75621]: DEBUG nova.network.neutron [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating instance_info_cache with network_info: [{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a3460a88-408c-4a8b-8a23-4ffb9408951e req-292bb7b9-e56f-447e-9b7a-f50d19db443e service nova] Releasing lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-changed-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Refreshing instance network info cache due to event network-changed-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] Acquiring lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] Acquired lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG nova.network.neutron [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Refreshing network info cache for port 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG nova.network.neutron [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updated VIF entry in instance network info cache for port 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG nova.network.neutron [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [{"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-836b2d78-a445-4e3a-9e88-a32baaa09b5c req-4cd61834-6b0d-4adb-8b3b-0285418723fa service nova] Releasing lock "refresh_cache-b70307e5-1672-437f-b582-79dea07c372c" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG nova.compute.manager [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] No waiting events found dispatching network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:36 user nova-compute[75621]: WARNING nova.compute.manager [req-a9cc1d38-3c38-405d-ab00-37fa82754208 req-e709045e-d941-47e8-b25d-fa5ffc56b3ab service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received unexpected event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 for instance with vm_state building and task_state spawning.
Nov 27 23:28:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:37 user nova-compute[75621]: INFO nova.compute.manager [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Terminating instance
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-unplugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] No waiting events found dispatching network-vif-unplugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-unplugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Acquiring lock "b70307e5-1672-437f-b582-79dea07c372c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] Lock "b70307e5-1672-437f-b582-79dea07c372c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:37 user nova-compute[75621]: DEBUG nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] No waiting events found dispatching network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:37 user nova-compute[75621]: WARNING nova.compute.manager [req-5a9a45ee-4410-4c79-9e15-6bb53f5a00ea req-32d4673f-ee55-4eaf-821c-a0f1fea075b5 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received unexpected event network-vif-plugged-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f for instance with vm_state active and task_state deleting.
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] Instance destroyed successfully.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid b70307e5-1672-437f-b582-79dea07c372c {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:26:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1187562876',display_name='tempest-TestVolumeBootPattern-server-1187562876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1187562876',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-x8t0qq6o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:26:58Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=b70307e5-1672-437f-b582-79dea07c372c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "address": "fa:16:3e:f4:84:3b", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69f0fe5a-97", "ovs_interfaceid": "69f0fe5a-975b-40b3-8f98-43e2b7e80b4f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_vif [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69f0fe5a-97, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00030496-6d73-475a-bd02-adbf3ea8a4de) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:28:38 user nova-compute[75621]: INFO os_vif [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:3b,bridge_name='br-int',has_traffic_filtering=True,id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69f0fe5a-97')
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:28:38 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a16a40b-ae55-4586-8a52-36865ee802c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:28:38 user nova-compute[75621]: No targets found.
Nov 27 23:28:38 user nova-compute[75621]: iSNS:
Nov 27 23:28:38 user nova-compute[75621]: No targets found.
Nov 27 23:28:38 user nova-compute[75621]: STATIC:
Nov 27 23:28:38 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:28:38 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:28:38 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:28:38 user nova-compute[75621]: FIRMWARE:
Nov 27 23:28:38 user nova-compute[75621]: No targets found.
Nov 27 23:28:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:28:38 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:28:38 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08bf085-3a1f-4f22-b8bc-afe56f9d3274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34d532-87bb-4d2a-a35a-68dc96eac4f0]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:28:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:28:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0570160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Instance spawned successfully.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa3555c-094c-4c33-89bf-1b07e76ccaef]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c22fe3a-f6ca-453e-a9eb-c7d04dc7b9ff]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[af77ba42-afa0-4f5e-8c3e-3ae28f78f303]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] No waiting events found dispatching network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:28:38 user nova-compute[75621]: WARNING nova.compute.manager [req-b1434e66-c6b8-46d7-b8c2-734588bf7812 req-9d7166f2-4079-43d7-bad9-455da7008a28 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received unexpected event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 for instance with vm_state building and task_state spawning.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e63f6-0760-4f6c-9b74-c06113272232]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5a73c4-a833-480e-a3b4-0d7ada9b6a4c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[179a4121-f16d-4c8e-8272-851d81fbdaa1]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]
Nov 27 23:28:38 user nova-compute[75621]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.
Nov 27 23:28:38 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.compute.manager [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Took 6.10 seconds to build instance.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceab4f06-6731-461e-a3b7-35b6f21923ac]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (292ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Deleting instance files /opt/stack/data/nova/instances/b70307e5-1672-437f-b582-79dea07c372c_del
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Deletion of /opt/stack/data/nova/instances/b70307e5-1672-437f-b582-79dea07c372c_del complete
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dec9743f-fb81-4f25-bdef-45c6e85a4758 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.206s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:38 user nova-compute[75621]: INFO nova.compute.manager [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 27 23:28:38 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:28:38 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:28:39 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:39 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: b70307e5-1672-437f-b582-79dea07c372c] Took 0.81 seconds to deallocate network for instance.
Nov 27 23:28:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-2ed242b0-1eab-4e13-9b8e-f6813eaf1f43 req-05707b9a-d6e5-4d23-921b-5a25c8f62bd1 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Received event network-vif-deleted-69f0fe5a-975b-40b3-8f98-43e2b7e80b4f {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:28:39 user nova-compute[75621]: INFO nova.compute.manager [req-2ed242b0-1eab-4e13-9b8e-f6813eaf1f43 req-05707b9a-d6e5-4d23-921b-5a25c8f62bd1 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Neutron deleted interface 69f0fe5a-975b-40b3-8f98-43e2b7e80b4f; detaching it from the instance and deleting it from the info cache
Nov 27 23:28:39 user nova-compute[75621]: DEBUG nova.network.neutron [req-2ed242b0-1eab-4e13-9b8e-f6813eaf1f43 req-05707b9a-d6e5-4d23-921b-5a25c8f62bd1 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:28:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-2ed242b0-1eab-4e13-9b8e-f6813eaf1f43 req-05707b9a-d6e5-4d23-921b-5a25c8f62bd1 service nova] [instance: b70307e5-1672-437f-b582-79dea07c372c] Detach interface failed, port_id=69f0fe5a-975b-40b3-8f98-43e2b7e80b4f, reason: Instance b70307e5-1672-437f-b582-79dea07c372c could not be found. {{(pid=75621) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 27 23:28:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:40 user nova-compute[75621]: INFO nova.compute.manager [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: b70307e5-1672-437f-b582-79dea07c372c] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 23:28:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:28:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:28:40 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:28:40 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:28:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:40 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance b70307e5-1672-437f-b582-79dea07c372c
Nov 27 23:28:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-333f03c4-8157-45f7-af32-8708ef94bca4 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "b70307e5-1672-437f-b582-79dea07c372c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.116s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:28:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:28:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:28:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:00 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-changed-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG nova.compute.manager [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Refreshing instance network info cache due to event network-changed-4a2bb9d8-9d8b-4291-807d-df31b1984307. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] Acquiring lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] Acquired lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:29:04 user nova-compute[75621]: DEBUG nova.network.neutron [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Refreshing network info cache for port 4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:29:05 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Ignoring supplied device name: /dev/vdb
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updated VIF entry in instance network info cache for port 4a2bb9d8-9d8b-4291-807d-df31b1984307. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG nova.network.neutron [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating instance_info_cache with network_info: [{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-534a032c-6ff9-4a0e-9173-4c64adceb0b1 req-281cb226-2e1f-4398-bf0e-9dddb0c293f5 service nova] Releasing lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:05 user nova-compute[75621]: INFO nova.compute.manager [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Attaching volume dce4b15c-254c-41d4-9c99-c14c98b1dcd7 to /dev/vdb
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.utils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c464c-8cfe-4f69-b4e1-7b540e3a04e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[03687712-86ce-4897-8850-9e2dbc0842da]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e4ad87-2179-4f7c-9a91-7373ebe11317]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b76250-a8c4-4e50-942b-4993dd8cc495]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:29:05 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7702ea7-7aa2-46b9-b99e-e88278dbdbbc]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG os_brick.utils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating existing volume attachment record: 005b4765-1693-4fb5-ab0f-8a4c99e6e95f {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:29:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:10 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrXqbUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:12 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:12 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:12 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fd5975-4b3a-411b-bfb9-d46fe818bb06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:29:12 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce48363-1396-48f4-8354-2301fcec5d8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7] added
Nov 27 23:29:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b89a7b-3798-4b90-8cb4-7d680268bb19]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24fa35b-d203-40ee-bb80-96d8df379ab1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrXqbUQx {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MrXqbUQx" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b0a3f-b18a-44d2-8f30-f2ff7680069c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MrXqbUQx'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c63eeb-4864-4406-94a6-2248330f52d0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[666fe9bc-3182-4e51-bae1-7365f73cbc73]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:29:12 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:29:12 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:12 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:29:12 user nova-compute[75621]: 
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dacece-d667-4728-a32d-7b05491d7b97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260]
Nov 27 23:29:12 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260] successful.
Nov 27 23:29:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af36a85-fefe-4af4-bec8-6793ebd230d8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b36533-1fd1-4828-930e-1be0bd5da22a]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:12 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa97a7d-f349-4033-9283-c16c820096a2]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:12 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrXqbUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26666313465616464', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666313465616464', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:29:13 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:29:13 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:29:13 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:29:13 user nova-compute[75621]:   <serial>dce4b15c-254c-41d4-9c99-c14c98b1dcd7</serial>
Nov 27 23:29:13 user nova-compute[75621]: </disk>
Nov 27 23:29:13 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No VIF found with MAC fa:16:3e:d0:6d:b4, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:29:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5c176efd-daf1-4397-8a2f-0013c7ae88f2 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.583s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:15 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:29:15 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.009960174560547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 97183148-efe1-4da2-9fd3-da793c15eaea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:29:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating instance_info_cache with network_info: [{"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-97183148-efe1-4da2-9fd3-da793c15eaea" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:29:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:29:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:29:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:29:29 user nova-compute[75621]: INFO nova.compute.claims [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Claim successful on node user
Nov 27 23:29:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:29:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.policy [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:29:30 user nova-compute[75621]: INFO nova.virt.block_device [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Booting with volume 2d8c4141-da96-49d0-b650-88647ef8e5e7 at /dev/vda
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.utils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26eaf2a-31e0-4933-a344-4f686c6abccc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[06df8896-d13f-42af-aa57-367caf336967]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8feb3d-98bd-4b09-98c8-3009c9373212]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6f7b62-e156-49ec-8496-528ea8020ef5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:29:30 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:29:30 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ea0c9-918d-4847-ac2f-281379acb18d]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG os_brick.utils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating existing volume attachment record: e74bfc5b-d648-4fc1-a9b6-5cdfa5fbb3a6 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:30 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Successfully created port: 8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Successfully updated port: 8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.compute.manager [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing instance network info cache due to event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Instance network_info: |[{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:29:31 user nova-compute[75621]: DEBUG nova.network.neutron [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:29:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updated VIF entry in instance network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:29:32 user nova-compute[75621]: DEBUG nova.network.neutron [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:29:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5dab9cda-9b64-466e-bef7-ac9671791479 req-e7c8e157-1fd6-4706-8aa8-a017e37b6915 service nova] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:29:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:34 user nova-compute[75621]: INFO nova.compute.manager [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Detaching volume dce4b15c-254c-41d4-9c99-c14c98b1dcd7
Nov 27 23:29:35 user nova-compute[75621]: INFO nova.virt.block_device [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Attempting to driver detach volume dce4b15c-254c-41d4-9c99-c14c98b1dcd7 from mountpoint /dev/vdb
Nov 27 23:29:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Attempting to detach device vdb from instance 97183148-efe1-4da2-9fd3-da793c15eaea from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:29:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:29:35 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:29:35 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:29:35 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:29:35 user nova-compute[75621]:   <serial>dce4b15c-254c-41d4-9c99-c14c98b1dcd7</serial>
Nov 27 23:29:35 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:29:35 user nova-compute[75621]: </disk>
Nov 27 23:29:35 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:29:35 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully detached device vdb from instance 97183148-efe1-4da2-9fd3-da793c15eaea from the persistent domain config.
Nov 27 23:29:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97183148-efe1-4da2-9fd3-da793c15eaea from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:29:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:29:35 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:29:35 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:29:35 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:29:35 user nova-compute[75621]:   <serial>dce4b15c-254c-41d4-9c99-c14c98b1dcd7</serial>
Nov 27 23:29:35 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:29:35 user nova-compute[75621]: </disk>
Nov 27 23:29:35 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:29:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:29:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Creating image(s)
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Ensure instance console log exists: /opt/stack/data/nova/instances/8f5d94a5-ab44-4e90-a084-fe73739cd25b/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Start _get_guest_xml network_info=[{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e74bfc5b-d648-4fc1-a9b6-5cdfa5fbb3a6', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8f5d94a5-ab44-4e90-a084-fe73739cd25b', 'attached_at': '', 'detached_at': '', 'volume_id': '2d8c4141-da96-49d0-b650-88647ef8e5e7', 'serial': '2d8c4141-da96-49d0-b650-88647ef8e5e7'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:29:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:29:37 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:37 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:37 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8485e2c3-4028-45f7-b074-63447c824a65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:29:37 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279a219-caba-4d1f-a5d1-8002246ad438]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7] added
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1cf5ea-274e-493c-a3ee-d96cf765b5a1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dc48bf-3a97-4c97-b16e-3f07460912af]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFJnmrGx {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TFJnmrGx" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0851b4eb-6360-40c4-acac-ea6f16b0a29f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TFJnmrGx'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef7abd9-e86d-40d9-8b54-53fe46e79f93]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[870a29fd-3b38-44d3-b44e-8b85e818a67e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a2ab04-af04-4ebf-a379-18afc94f2f4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]
Nov 27 23:29:37 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[14dc529a-4295-422d-aaa5-c73ee34236d0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[468677bf-ad5c-4dbc-bbc5-dc0451a53141]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:37 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[87216ac5-c1da-4441-a891-90165f1d748d]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:37 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26366663462393937', 'path': '/dev/sdc'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663462393937', 'path': '/dev/sdc'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18266476',display_name='tempest-TestVolumeBootPattern-server-18266476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18266476',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-r6eowe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:29:30Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=8f5d94a5-ab44-4e90-a084-fe73739cd25b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f5d94a5-ab44-4e90-a084-fe73739cd25b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:29:38 user nova-compute[75621]:   <uuid>8f5d94a5-ab44-4e90-a084-fe73739cd25b</uuid>
Nov 27 23:29:38 user nova-compute[75621]:   <name>instance-00000030</name>
Nov 27 23:29:38 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:29:38 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:29:38 user nova-compute[75621]:   <metadata>
Nov 27 23:29:38 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:29:38 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:29:38 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-server-18266476</nova:name>
Nov 27 23:29:38 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:29:37</nova:creationTime>
Nov 27 23:29:38 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:29:38 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:29:38 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:29:38 user nova-compute[75621]:       <nova:owner>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:29:38 user nova-compute[75621]:       </nova:owner>
Nov 27 23:29:38 user nova-compute[75621]:       <nova:ports>
Nov 27 23:29:38 user nova-compute[75621]:         <nova:port uuid="8d613078-9619-48fa-9f6d-4d4224fd9824">
Nov 27 23:29:38 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 27 23:29:38 user nova-compute[75621]:         </nova:port>
Nov 27 23:29:38 user nova-compute[75621]:       </nova:ports>
Nov 27 23:29:38 user nova-compute[75621]:     </nova:instance>
Nov 27 23:29:38 user nova-compute[75621]:   </metadata>
Nov 27 23:29:38 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:29:38 user nova-compute[75621]:     <system>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="serial">8f5d94a5-ab44-4e90-a084-fe73739cd25b</entry>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="uuid">8f5d94a5-ab44-4e90-a084-fe73739cd25b</entry>
Nov 27 23:29:38 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:29:38 user nova-compute[75621]:     </system>
Nov 27 23:29:38 user nova-compute[75621]:   </sysinfo>
Nov 27 23:29:38 user nova-compute[75621]:   <os>
Nov 27 23:29:38 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:29:38 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:29:38 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:29:38 user nova-compute[75621]:   </os>
Nov 27 23:29:38 user nova-compute[75621]:   <features>
Nov 27 23:29:38 user nova-compute[75621]:     <acpi/>
Nov 27 23:29:38 user nova-compute[75621]:     <apic/>
Nov 27 23:29:38 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:29:38 user nova-compute[75621]:   </features>
Nov 27 23:29:38 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:29:38 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:29:38 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:29:38 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:29:38 user nova-compute[75621]:   </clock>
Nov 27 23:29:38 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:29:38 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:29:38 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:29:38 user nova-compute[75621]:   </cpu>
Nov 27 23:29:38 user nova-compute[75621]:   <devices>
Nov 27 23:29:38 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:29:38 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:29:38 user nova-compute[75621]:       <source dev="/dev/sdc"/>
Nov 27 23:29:38 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:29:38 user nova-compute[75621]:       <serial>2d8c4141-da96-49d0-b650-88647ef8e5e7</serial>
Nov 27 23:29:38 user nova-compute[75621]:     </disk>
Nov 27 23:29:38 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:29:38 user nova-compute[75621]:       <mac address="fa:16:3e:04:c3:fc"/>
Nov 27 23:29:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:29:38 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:29:38 user nova-compute[75621]:       <target dev="tap8d613078-96"/>
Nov 27 23:29:38 user nova-compute[75621]:     </interface>
Nov 27 23:29:38 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:29:38 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/8f5d94a5-ab44-4e90-a084-fe73739cd25b/console.log" append="off"/>
Nov 27 23:29:38 user nova-compute[75621]:     </serial>
Nov 27 23:29:38 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:29:38 user nova-compute[75621]:     <video>
Nov 27 23:29:38 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:29:38 user nova-compute[75621]:     </video>
Nov 27 23:29:38 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:29:38 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:29:38 user nova-compute[75621]:     </rng>
Nov 27 23:29:38 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:29:38 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:29:38 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:29:38 user nova-compute[75621]:     </memballoon>
Nov 27 23:29:38 user nova-compute[75621]:   </devices>
Nov 27 23:29:38 user nova-compute[75621]: </domain>
Nov 27 23:29:38 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18266476',display_name='tempest-TestVolumeBootPattern-server-18266476',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18266476',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-r6eowe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:29:30Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=8f5d94a5-ab44-4e90-a084-fe73739cd25b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG os_vif [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '366fdbbc-6bb8-560d-bab5-625ef87fc91e', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d613078-96, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d613078-96, col_values=(('qos', UUID('bb10569e-481b-4f56-8fb0-d09e6576476c')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d613078-96, col_values=(('external_ids', {'iface-id': '8d613078-9619-48fa-9f6d-4d4224fd9824', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:c3:fc', 'vm-uuid': '8f5d94a5-ab44-4e90-a084-fe73739cd25b'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:38 user nova-compute[75621]: INFO os_vif [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96')
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:29:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:04:c3:fc, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:29:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] No waiting events found dispatching network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:29:40 user nova-compute[75621]: WARNING nova.compute.manager [req-7cc47ada-c2e4-45f0-82ae-7bc9d819bb61 req-c9281089-f570-4cec-bba9-69aa01a55c5d service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received unexpected event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 for instance with vm_state building and task_state spawning.
Nov 27 23:29:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:29:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Instance spawned successfully.
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:29:42 user nova-compute[75621]: INFO nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:29:42 user nova-compute[75621]: INFO nova.compute.manager [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Took 12.51 seconds to build instance.
Nov 27 23:29:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-c8a3b0ca-4597-422b-baba-f5f9d10630f9 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.613s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:42 user nova-compute[75621]: DEBUG nova.compute.manager [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] No waiting events found dispatching network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:29:42 user nova-compute[75621]: WARNING nova.compute.manager [req-e6824ea9-c7e8-44cc-a7fc-e373a571d520 req-df410e09-3201-4563-acb1-5d16278da717 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received unexpected event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 for instance with vm_state active and task_state None.
Nov 27 23:29:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:29:55 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 97183148-efe1-4da2-9fd3-da793c15eaea is timed out.
Nov 27 23:29:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully detached device vdb from instance 97183148-efe1-4da2-9fd3-da793c15eaea from the live domain config.
Nov 27 23:29:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrXqbUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:55 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fbcabc-8ad3-43f4-9740-5bac2ca16226]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:29:55 user nova-compute[75621]: No targets found.
Nov 27 23:29:55 user nova-compute[75621]: iSNS:
Nov 27 23:29:55 user nova-compute[75621]: No targets found.
Nov 27 23:29:55 user nova-compute[75621]: STATIC:
Nov 27 23:29:55 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7
Nov 27 23:29:55 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:29:55 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:29:55 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:29:55 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:29:55 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:29:55 user nova-compute[75621]: FIRMWARE:
Nov 27 23:29:55 user nova-compute[75621]: No targets found.
Nov 27 23:29:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:29:55 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:29:55 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb263a8b-1716-4f22-801e-4d63e7fde95c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b1aa04-b952-490f-a4b7-7353b7850ad8]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:55 user nova-compute[75621]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 (non-flash)
Nov 27 23:29:55 user nova-compute[75621]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e075a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff66786-ac3c-491a-8d46-35067f204b65]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7977e2-6f75-450b-8c33-b33f902cb7e0]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9aeacc-a10e-4698-a9d3-c2023ecf3010]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8cf76a0-cb4f-4ee6-98c1-675f7f00ea4a]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b43ff04-dfd3-4c7a-b023-c947a25ef8d4]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[076065de-065d-4d98-94c9-da3cc8bf9663]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260]
Nov 27 23:29:55 user nova-compute[75621]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7, portal: 172.16.0.220,3260] successful.
Nov 27 23:29:55 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aea3f4-3128-435d-94e9-4367f3579740]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== disconnect_volume: return (293ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG nova.objects.instance [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-43c3e1b3-e9b5-46cc-8ce4-725bcef27743 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.635s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.428s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:56 user nova-compute[75621]: INFO nova.compute.manager [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Terminating instance
Nov 27 23:29:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-unplugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] No waiting events found dispatching network-vif-unplugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:29:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-d772e788-3918-45ed-9e7d-ce695e9f0177 req-8259c961-afb7-46b4-8e04-e5fce777adb3 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-unplugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:29:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Instance destroyed successfully.
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'resources' on Instance uuid 97183148-efe1-4da2-9fd3-da793c15eaea {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:27:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1041501852',display_name='tempest-VolumesSnapshotTestJSON-instance-1041501852',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1041501852',id=46,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSqt7fg4pgGCHmfjaOCudOVqK6Mq5ft4BNyPSIr8ThwJeLUXbuTbr2mOLQVH3sCmpJKjMhX2eaGY8JyRIaQojBxGmZ6+4uk/7es0oPHpD/HucUs8oUJDAulbPMOQ/ucQg==',key_name='tempest-keypair-1275502151',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:27:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-0akqja9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:27:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=97183148-efe1-4da2-9fd3-da793c15eaea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "address": "fa:16:3e:d0:6d:b4", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a2bb9d8-9d", "ovs_interfaceid": "4a2bb9d8-9d8b-4291-807d-df31b1984307", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_vif [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a2bb9d8-9d, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e623d2af-d743-45c2-b5be-da484f60953e) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:29:57 user nova-compute[75621]: INFO os_vif [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:6d:b4,bridge_name='br-int',has_traffic_filtering=True,id=4a2bb9d8-9d8b-4291-807d-df31b1984307,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a2bb9d8-9d')
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MrXqbUQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:29:57 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fa057-8432-48be-ab16-864db46defc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:29:57 user nova-compute[75621]: No targets found.
Nov 27 23:29:57 user nova-compute[75621]: iSNS:
Nov 27 23:29:57 user nova-compute[75621]: No targets found.
Nov 27 23:29:57 user nova-compute[75621]: STATIC:
Nov 27 23:29:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:29:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:29:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:29:57 user nova-compute[75621]: FIRMWARE:
Nov 27 23:29:57 user nova-compute[75621]: No targets found.
Nov 27 23:29:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:29:57 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:29:57 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce4b15c-254c-41d4-9c99-c14c98b1dcd7', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbe2e93-fdcb-4c65-b665-bca87346ab32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e418981a-8734-4456-b895-900aa4bcd19e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:29:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0759480>, {}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Disconnecting from: [] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== disconnect_volume: return (70ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:29:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Deleting instance files /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea_del
Nov 27 23:29:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Deletion of /opt/stack/data/nova/instances/97183148-efe1-4da2-9fd3-da793c15eaea_del complete
Nov 27 23:29:57 user nova-compute[75621]: INFO nova.compute.manager [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 23:29:57 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:29:57 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:29:58 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Took 0.65 seconds to deallocate network for instance.
Nov 27 23:29:58 user nova-compute[75621]: WARNING nova.volume.cinder [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Attachment 005b4765-1693-4fb5-ab0f-8a4c99e6e95f does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 005b4765-1693-4fb5-ab0f-8a4c99e6e95f. (HTTP 404) (Request-ID: req-8bc0b5a1-1e79-4974-836f-7732002309f7)
Nov 27 23:29:58 user nova-compute[75621]: INFO nova.compute.manager [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Took 0.03 seconds to detach 1 volumes for instance.
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.168s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:58 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Deleted allocations for instance 97183148-efe1-4da2-9fd3-da793c15eaea
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3c31fb1c-0b4a-47c3-bbc2-1fbbb52b35e0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "97183148-efe1-4da2-9fd3-da793c15eaea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] Acquiring lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] Lock "97183148-efe1-4da2-9fd3-da793c15eaea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] No waiting events found dispatching network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:29:58 user nova-compute[75621]: WARNING nova.compute.manager [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received unexpected event network-vif-plugged-4a2bb9d8-9d8b-4291-807d-df31b1984307 for instance with vm_state deleted and task_state None.
Nov 27 23:29:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-a7f8feda-1a24-4c1b-8835-f2425534dd7f req-c8078f65-6fea-4196-a336-2c1463f1c364 service nova] [instance: 97183148-efe1-4da2-9fd3-da793c15eaea] Received event network-vif-deleted-4a2bb9d8-9d8b-4291-807d-df31b1984307 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:29:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:30:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:13 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:30:14 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8780MB free_disk=25.027873992919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:30:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:30:15 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:30:15 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:30:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:30:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:30:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:30:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating instance_info_cache with network_info: [{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:30:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-changed-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Refreshing instance network info cache due to event network-changed-e74fc736-ab01-4c17-8e46-9d9be99933c2. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] Acquiring lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] Acquired lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:30:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Refreshing network info cache for port e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:30:23 user nova-compute[75621]: DEBUG nova.network.neutron [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updated VIF entry in instance network info cache for port e74fc736-ab01-4c17-8e46-9d9be99933c2. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:30:23 user nova-compute[75621]: DEBUG nova.network.neutron [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating instance_info_cache with network_info: [{"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:30:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4bd0a924-a2ec-4706-9057-5f4c9a1effd3 req-1e60a8e5-6919-4229-adef-a6d566fe8ee5 service nova] Releasing lock "refresh_cache-1d1aba93-17a1-4c66-8a23-b3f6f694b970" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:30:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lazy-loading 'flavor' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:26 user nova-compute[75621]: INFO nova.compute.manager [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Attaching volume 575b3f05-0030-4063-8a3a-b627e509688f to /dev/vdb
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e7f398-1f20-4059-8fd1-e189eaef4f6b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b009d224-7683-450f-b01c-d7d9ab638e22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea879780-773b-404b-a0c7-3d237da237e7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5382e09-bd4c-4105-b456-925c92f53d34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:30:26 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:30:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a12ecc-491f-42ea-8bb5-d3836b1b6f29]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG os_brick.utils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:30:26 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating existing volume attachment record: 65c6dd3f-627c-4739-9318-01391a0eba92 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:30:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlyUSCcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:30:33 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:30:33 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:30:33 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d907dca1-cacb-4f1a-a6a4-fcded2ce9ba1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:30:33 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bb66f9-a922-4dca-9c6a-dd377a84c42b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f] added
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd930edd-2749-4695-9653-960309f95e1b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3b108d-ba4a-4409-bab0-baa89c14c32b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlyUSCcB {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QlyUSCcB" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d40839-3e99-418e-9528-9b655b6a452b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QlyUSCcB'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ba7490-9238-4781-9a04-ae633aa94ea6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6604b734-32cc-4c73-844c-35032860a606]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bbb36d-e0e4-4015-9e89-fb14d520c443]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260]
Nov 27 23:30:33 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260] successful.
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[637701d8-c124-4de8-8d95-31ad96d0a3ca]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[10767ec3-56c7-452a-be4d-ce07ad35e2a1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:33 user nova-compute[75621]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:33 user nova-compute[75621]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)
Nov 27 23:30:33 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[04991c53-3b30-4053-bcf8-30cf53140949]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:33 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlyUSCcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '26362626231363830', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362626231363830', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.objects.instance [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lazy-loading 'flavor' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:30:34 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:30:34 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:30:34 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:30:34 user nova-compute[75621]:   <serial>575b3f05-0030-4063-8a3a-b627e509688f</serial>
Nov 27 23:30:34 user nova-compute[75621]: </disk>
Nov 27 23:30:34 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:30:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] No VIF found with MAC fa:16:3e:b0:eb:eb, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:30:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-8740c147-0928-4f65-a134-acc1940f83e3 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.688s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:36 user nova-compute[75621]: INFO nova.compute.manager [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Detaching volume 575b3f05-0030-4063-8a3a-b627e509688f
Nov 27 23:30:37 user nova-compute[75621]: INFO nova.virt.block_device [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Attempting to driver detach volume 575b3f05-0030-4063-8a3a-b627e509688f from mountpoint /dev/vdb
Nov 27 23:30:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Attempting to detach device vdb from instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:30:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:30:37 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:30:37 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:30:37 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:30:37 user nova-compute[75621]:   <serial>575b3f05-0030-4063-8a3a-b627e509688f</serial>
Nov 27 23:30:37 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:30:37 user nova-compute[75621]: </disk>
Nov 27 23:30:37 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:30:37 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Successfully detached device vdb from instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 from the persistent domain config.
Nov 27 23:30:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:30:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:30:37 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:30:37 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:30:37 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:30:37 user nova-compute[75621]:   <serial>575b3f05-0030-4063-8a3a-b627e509688f</serial>
Nov 27 23:30:37 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:30:37 user nova-compute[75621]: </disk>
Nov 27 23:30:37 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:30:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:30:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:30:42 user nova-compute[75621]: INFO nova.compute.claims [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Claim successful on node user
Nov 27 23:30:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:30:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.policy [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '69bb978f984e4b6eac393c6d879d5f20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8803295cb17944c5b2457facfbbbf5fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:30:42 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Creating image(s)
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "/opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "/opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:42 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk 1073741824" returned: 0 in 0.054s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Successfully created port: 2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.170s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Cannot resize image /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Ensure instance console log exists: /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Successfully updated port: 2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquired lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-changed-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.compute.manager [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Refreshing instance network info cache due to event network-changed-2886271f-c305-4634-b80e-e76eb145254b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] Acquiring lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:30:43 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.neutron [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updating instance_info_cache with network_info: [{"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Releasing lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Instance network_info: |[{"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] Acquired lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Refreshing network info cache for port 2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Start _get_guest_xml network_info=[{"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:30:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:30:44 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1005587619',display_name='tempest-VolumesSnapshotTestJSON-instance-1005587619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1005587619',id=49,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOfkyX9WXLQ/fIJbcVA/hJ26xRs2tYUnr8mLve/RPEaC69JCS2ujIhdlkWZi+A1YfGmTDIuwZ7zhIxvqURLk3bSmuPk5LWY1JtHl/WbMts1jXaEPDmqwJcclwh+I5i7rw==',key_name='tempest-keypair-431697498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-caphuv6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.objects.instance [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:30:44 user nova-compute[75621]:   <uuid>4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd</uuid>
Nov 27 23:30:44 user nova-compute[75621]:   <name>instance-00000031</name>
Nov 27 23:30:44 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:30:44 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:30:44 user nova-compute[75621]:   <metadata>
Nov 27 23:30:44 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:30:44 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1005587619</nova:name>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:30:44</nova:creationTime>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:30:44 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:30:44 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:owner>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:user uuid="69bb978f984e4b6eac393c6d879d5f20">tempest-VolumesSnapshotTestJSON-1370947947-project-member</nova:user>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:project uuid="8803295cb17944c5b2457facfbbbf5fd">tempest-VolumesSnapshotTestJSON-1370947947</nova:project>
Nov 27 23:30:44 user nova-compute[75621]:       </nova:owner>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:30:44 user nova-compute[75621]:       <nova:ports>
Nov 27 23:30:44 user nova-compute[75621]:         <nova:port uuid="2886271f-c305-4634-b80e-e76eb145254b">
Nov 27 23:30:44 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 27 23:30:44 user nova-compute[75621]:         </nova:port>
Nov 27 23:30:44 user nova-compute[75621]:       </nova:ports>
Nov 27 23:30:44 user nova-compute[75621]:     </nova:instance>
Nov 27 23:30:44 user nova-compute[75621]:   </metadata>
Nov 27 23:30:44 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:30:44 user nova-compute[75621]:     <system>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="serial">4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd</entry>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="uuid">4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd</entry>
Nov 27 23:30:44 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:30:44 user nova-compute[75621]:     </system>
Nov 27 23:30:44 user nova-compute[75621]:   </sysinfo>
Nov 27 23:30:44 user nova-compute[75621]:   <os>
Nov 27 23:30:44 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:30:44 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:30:44 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:30:44 user nova-compute[75621]:   </os>
Nov 27 23:30:44 user nova-compute[75621]:   <features>
Nov 27 23:30:44 user nova-compute[75621]:     <acpi/>
Nov 27 23:30:44 user nova-compute[75621]:     <apic/>
Nov 27 23:30:44 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:30:44 user nova-compute[75621]:   </features>
Nov 27 23:30:44 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:30:44 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:30:44 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:30:44 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:30:44 user nova-compute[75621]:   </clock>
Nov 27 23:30:44 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:30:44 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:30:44 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:30:44 user nova-compute[75621]:   </cpu>
Nov 27 23:30:44 user nova-compute[75621]:   <devices>
Nov 27 23:30:44 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:30:44 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:30:44 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk"/>
Nov 27 23:30:44 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:30:44 user nova-compute[75621]:     </disk>
Nov 27 23:30:44 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:30:44 user nova-compute[75621]:       <mac address="fa:16:3e:11:91:86"/>
Nov 27 23:30:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:30:44 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:30:44 user nova-compute[75621]:       <target dev="tap2886271f-c3"/>
Nov 27 23:30:44 user nova-compute[75621]:     </interface>
Nov 27 23:30:44 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:30:44 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/console.log" append="off"/>
Nov 27 23:30:44 user nova-compute[75621]:     </serial>
Nov 27 23:30:44 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:30:44 user nova-compute[75621]:     <video>
Nov 27 23:30:44 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:30:44 user nova-compute[75621]:     </video>
Nov 27 23:30:44 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:30:44 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:30:44 user nova-compute[75621]:     </rng>
Nov 27 23:30:44 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:30:44 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:30:44 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:30:44 user nova-compute[75621]:     </memballoon>
Nov 27 23:30:44 user nova-compute[75621]:   </devices>
Nov 27 23:30:44 user nova-compute[75621]: </domain>
Nov 27 23:30:44 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1005587619',display_name='tempest-VolumesSnapshotTestJSON-instance-1005587619',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1005587619',id=49,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOfkyX9WXLQ/fIJbcVA/hJ26xRs2tYUnr8mLve/RPEaC69JCS2ujIhdlkWZi+A1YfGmTDIuwZ7zhIxvqURLk3bSmuPk5LWY1JtHl/WbMts1jXaEPDmqwJcclwh+I5i7rw==',key_name='tempest-keypair-431697498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-caphuv6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:30:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG os_vif [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '991d65a1-0998-5857-be93-bdc997fab670', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2886271f-c3, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2886271f-c3, col_values=(('qos', UUID('de1e4975-de68-4460-b45c-ca69e6f7e812')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2886271f-c3, col_values=(('external_ids', {'iface-id': '2886271f-c305-4634-b80e-e76eb145254b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:91:86', 'vm-uuid': '4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:44 user nova-compute[75621]: INFO os_vif [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3')
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No VIF found with MAC fa:16:3e:11:91:86, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updated VIF entry in instance network info cache for port 2886271f-c305-4634-b80e-e76eb145254b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG nova.network.neutron [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updating instance_info_cache with network_info: [{"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:30:44 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4655b631-e317-4dfc-a1b0-46ded377ed35 req-c1fa0e24-a9d9-4153-9695-907b45cb7320 service nova] Releasing lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:45 user nova-compute[75621]: DEBUG nova.compute.manager [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] No waiting events found dispatching network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:30:45 user nova-compute[75621]: WARNING nova.compute.manager [req-583bfcb0-62e2-4203-a31d-2500d7761251 req-e2d52921-cf3a-44a0-87c7-eb5fc0198708 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received unexpected event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b for instance with vm_state building and task_state spawning.
Nov 27 23:30:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:30:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Instance spawned successfully.
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:30:47 user nova-compute[75621]: INFO nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] No waiting events found dispatching network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:30:47 user nova-compute[75621]: WARNING nova.compute.manager [req-de2bfa40-88ef-4b29-8c2d-8645f0670152 req-41c475ad-8fed-45fa-b876-b03fbbcad06c service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received unexpected event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b for instance with vm_state active and task_state None.
Nov 27 23:30:47 user nova-compute[75621]: INFO nova.compute.manager [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Took 5.57 seconds to build instance.
Nov 27 23:30:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-36c07d08-4634-4e2c-afc5-b6ff80b414b0 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.665s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:30:57 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 is timed out.
Nov 27 23:30:57 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Successfully detached device vdb from instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 from the live domain config.
Nov 27 23:30:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QlyUSCcB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:30:57 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9e1b11-313f-42eb-8575-11999a82f849]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:30:57 user nova-compute[75621]: No targets found.
Nov 27 23:30:57 user nova-compute[75621]: iSNS:
Nov 27 23:30:57 user nova-compute[75621]: No targets found.
Nov 27 23:30:57 user nova-compute[75621]: STATIC:
Nov 27 23:30:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:30:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:30:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:30:57 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f
Nov 27 23:30:57 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:30:57 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:30:57 user nova-compute[75621]: FIRMWARE:
Nov 27 23:30:57 user nova-compute[75621]: No targets found.
Nov 27 23:30:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:30:57 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:30:57 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba647500-b855-4849-8aa2-96ba67eda263]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebc8aa8-3112-4673-970b-02119a654528]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:57 user nova-compute[75621]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)
Nov 27 23:30:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:30:57 user nova-compute[75621]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f (non-flash)
Nov 27 23:30:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e077e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[de65aef6-b4b0-4f59-ad8e-8bc496f9c1e3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec859b9-6bb0-4d65-8828-190721fef814]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d9d7d0-7960-451b-9f8c-9861452caae8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b2e9f2-3f45-4f98-9a05-2baabf4b5867]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[698314b0-b683-4c7f-8017-04600276be07]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[486c9ea7-4854-4ef4-98b4-ac59ca516518]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260]
Nov 27 23:30:57 user nova-compute[75621]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f, portal: 172.16.0.220,3260] successful.
Nov 27 23:30:57 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:575b3f05-0030-4063-8a3a-b627e509688f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d208fe-628b-4cc0-9404-485ec1bc2a49]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] <== disconnect_volume: return (316ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:30:57 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:30:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lazy-loading 'flavor' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:30:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-96e94c9c-bc9f-4674-a89c-56dca9d1282f tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:30:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:02 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:08 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:31:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:14 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:15 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:16 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:31:16 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8688MB free_disk=24.997207641601562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:31:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing instance network info cache due to event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG nova.network.neutron [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:31:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updated VIF entry in instance network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG nova.network.neutron [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d283bcb1-a8af-4768-a528-7f19647effe1 req-66167a6f-6a6b-47f7-8e30-1e8c597da505 service nova] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:31:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:31:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:31:27 user nova-compute[75621]: INFO nova.compute.claims [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Claim successful on node user
Nov 27 23:31:27 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:31:28 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:31:28 user nova-compute[75621]: INFO nova.virt.block_device [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Booting with volume 26b73f62-be67-479c-a490-d45667b63052 at /dev/vda
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.policy [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3a15c55aeca4eb8a0327957fd5d38b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c394c68191644ed9f8a5e071b7b55dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.utils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c709b8ba-d76d-423e-ad45-5786cc2f9fff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[35abb084-5af3-4d3e-b053-f6c37efafd8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[def849f0-d8da-4efb-bc33-8cb1bc7ea6af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca683e-3d8c-41c9-86cf-260181fd0d57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:31:28 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:31:28 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c473e1db-e92b-42b1-a3a2-1b9446805d50]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG os_brick.utils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating existing volume attachment record: d6f25d72-6b3d-419a-9ffe-ed9f77149c05 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:31:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Successfully created port: 5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Successfully updated port: 5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquired lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.compute.manager [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing instance network info cache due to event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] Acquiring lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating instance_info_cache with network_info: [{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Releasing lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Instance network_info: |[{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] Acquired lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:31:29 user nova-compute[75621]: DEBUG nova.network.neutron [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:31:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updated VIF entry in instance network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:31:30 user nova-compute[75621]: DEBUG nova.network.neutron [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating instance_info_cache with network_info: [{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:31:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-08978239-e788-43c6-a316-ace90da32c0f req-e3debcb8-27c7-4c27-b1f2-6ccbbb01bae9 service nova] Releasing lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:32 user nova-compute[75621]: INFO nova.compute.manager [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Terminating instance
Nov 27 23:31:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-unplugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] No waiting events found dispatching network-vif-unplugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-ee0c4673-328c-4af9-b1db-bff590f4b2c0 req-71a0166f-608a-4cf8-9061-770e20694df4 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-unplugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Instance destroyed successfully.
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lazy-loading 'resources' on Instance uuid 1d1aba93-17a1-4c66-8a23-b3f6f694b970 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:28:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1582993687',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1582993',id=47,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHopEhhGaWX7PhhQ/S5RhdjzBPpCiJ6HZDULn/TjS2Ca4VcMnG0SuODhpD1DO7stzFnpWv1M1tm6P+l1zkNYG7XSln5JmXAcDgNEj5oDobEErAn8glf0YiKsJ+oKri4dug==',key_name='tempest-keypair-1180736784',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:28:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff63f129421545debc5d467733803dd0',ramdisk_id='',reservation_id='r-nnjzf148',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b45cfa90af449cd8ce3fd9bd36dbec2',uuid=1d1aba93-17a1-4c66-8a23-b3f6f694b970,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converting VIF {"id": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "address": "fa:16:3e:b0:eb:eb", "network": {"id": "906aef3d-5c59-4a45-93dd-ffac73f5dd85", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1979402723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff63f129421545debc5d467733803dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape74fc736-ab", "ovs_interfaceid": "e74fc736-ab01-4c17-8e46-9d9be99933c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG os_vif [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape74fc736-ab, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bac9d88-fa7e-421d-b030-c38113271ed9) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:33 user nova-compute[75621]: INFO os_vif [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:eb:eb,bridge_name='br-int',has_traffic_filtering=True,id=e74fc736-ab01-4c17-8e46-9d9be99933c2,network=Network(906aef3d-5c59-4a45-93dd-ffac73f5dd85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape74fc736-ab')
Nov 27 23:31:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Deleting instance files /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970_del
Nov 27 23:31:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Deletion of /opt/stack/data/nova/instances/1d1aba93-17a1-4c66-8a23-b3f6f694b970_del complete
Nov 27 23:31:33 user nova-compute[75621]: INFO nova.compute.manager [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 27 23:31:33 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:31:33 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:31:34 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Took 0.86 seconds to deallocate network for instance.
Nov 27 23:31:34 user nova-compute[75621]: DEBUG nova.compute.manager [req-6d3bad5f-1b5e-4a74-8aaa-890fa6355724 req-663add7e-5a60-4dea-a7d8-eacd30240b97 service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-deleted-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:31:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.239s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:34 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Deleted allocations for instance 1d1aba93-17a1-4c66-8a23-b3f6f694b970
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b446f5af-da7d-47c8-b841-16d6e1755192 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727 tempest-TestServerVolumeAttachScenarioOldVersion-2114358727-project-member] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:31:35 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Creating image(s)
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Did not create local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Ensure instance console log exists: /opt/stack/data/nova/instances/d0267acc-43ca-412e-86c1-d55000f76997/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Start _get_guest_xml network_info=[{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'd6f25d72-6b3d-419a-9ffe-ed9f77149c05', 'delete_on_termination': False, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKPFBmZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd0267acc-43ca-412e-86c1-d55000f76997', 'attached_at': '', 'detached_at': '', 'volume_id': '26b73f62-be67-479c-a490-d45667b63052', 'serial': '26b73f62-be67-479c-a490-d45667b63052'}, 'volume_type': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:31:35 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:31:35 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKPFBmZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:31:35 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:31:35 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:31:35 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] Acquiring lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] Lock "1d1aba93-17a1-4c66-8a23-b3f6f694b970-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG nova.compute.manager [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] No waiting events found dispatching network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:31:35 user nova-compute[75621]: WARNING nova.compute.manager [req-38614581-436b-4b71-9d9f-bedf2dfd8bd1 req-79ec9124-f039-4ebd-ae27-4c2063e295be service nova] [instance: 1d1aba93-17a1-4c66-8a23-b3f6f694b970] Received unexpected event network-vif-plugged-e74fc736-ab01-4c17-8e46-9d9be99933c2 for instance with vm_state deleted and task_state None.
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fedca48-b820-4b7c-8c62-716a0a09578b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:31:35 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[da43a3f2-12b2-41d0-b4cc-ea4fcc828044]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052] added
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.057s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ef59e4-4338-4707-8d3d-8404ab7f0a5e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d53d81-a283-43fe-9903-79b0b30c51ed]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKPFBmZL {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JKPFBmZL" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[720dc711-af37-44cf-96bc-7949f157ed4b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JKPFBmZL'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1367ba7e-cad8-42f3-838c-040fcc0e230d]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27b81b5-64fa-4dd2-b289-83c8f72c3ef5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc76adc2-aba6-4813-8c95-31d01d9524ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260]
Nov 27 23:31:35 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260] successful.
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a72034-b0cf-44df-a60a-b81323c6022f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b6b64-bd69-47ac-bf7f-5421f09d77fb]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:31:35 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad5918d-abe4-406f-b618-2b4846d76bee]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:31:35 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKPFBmZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23162346130656436', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162346130656436', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189741647',display_name='tempest-TestVolumeBootPattern-server-189741647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189741647',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-6jmes9i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:31:28Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d0267acc-43ca-412e-86c1-d55000f76997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.objects.instance [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'pci_devices' on Instance uuid d0267acc-43ca-412e-86c1-d55000f76997 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:31:36 user nova-compute[75621]:   <uuid>d0267acc-43ca-412e-86c1-d55000f76997</uuid>
Nov 27 23:31:36 user nova-compute[75621]:   <name>instance-00000032</name>
Nov 27 23:31:36 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:31:36 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:31:36 user nova-compute[75621]:   <metadata>
Nov 27 23:31:36 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:31:36 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:31:36 user nova-compute[75621]:       <nova:name>tempest-TestVolumeBootPattern-server-189741647</nova:name>
Nov 27 23:31:36 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:31:35</nova:creationTime>
Nov 27 23:31:36 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:31:36 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:31:36 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:31:36 user nova-compute[75621]:       <nova:owner>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:user uuid="b3a15c55aeca4eb8a0327957fd5d38b9">tempest-TestVolumeBootPattern-11911166-project-member</nova:user>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:project uuid="4c394c68191644ed9f8a5e071b7b55dc">tempest-TestVolumeBootPattern-11911166</nova:project>
Nov 27 23:31:36 user nova-compute[75621]:       </nova:owner>
Nov 27 23:31:36 user nova-compute[75621]:       <nova:ports>
Nov 27 23:31:36 user nova-compute[75621]:         <nova:port uuid="5033dcd6-8031-4045-ac54-bd4bb2056dce">
Nov 27 23:31:36 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 27 23:31:36 user nova-compute[75621]:         </nova:port>
Nov 27 23:31:36 user nova-compute[75621]:       </nova:ports>
Nov 27 23:31:36 user nova-compute[75621]:     </nova:instance>
Nov 27 23:31:36 user nova-compute[75621]:   </metadata>
Nov 27 23:31:36 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:31:36 user nova-compute[75621]:     <system>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="serial">d0267acc-43ca-412e-86c1-d55000f76997</entry>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="uuid">d0267acc-43ca-412e-86c1-d55000f76997</entry>
Nov 27 23:31:36 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:31:36 user nova-compute[75621]:     </system>
Nov 27 23:31:36 user nova-compute[75621]:   </sysinfo>
Nov 27 23:31:36 user nova-compute[75621]:   <os>
Nov 27 23:31:36 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:31:36 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:31:36 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:31:36 user nova-compute[75621]:   </os>
Nov 27 23:31:36 user nova-compute[75621]:   <features>
Nov 27 23:31:36 user nova-compute[75621]:     <acpi/>
Nov 27 23:31:36 user nova-compute[75621]:     <apic/>
Nov 27 23:31:36 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:31:36 user nova-compute[75621]:   </features>
Nov 27 23:31:36 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:31:36 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:31:36 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:31:36 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:31:36 user nova-compute[75621]:   </clock>
Nov 27 23:31:36 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:31:36 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:31:36 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:31:36 user nova-compute[75621]:   </cpu>
Nov 27 23:31:36 user nova-compute[75621]:   <devices>
Nov 27 23:31:36 user nova-compute[75621]:     <disk type="block" device="disk">
Nov 27 23:31:36 user nova-compute[75621]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:31:36 user nova-compute[75621]:       <source dev="/dev/sdb"/>
Nov 27 23:31:36 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:31:36 user nova-compute[75621]:       <serial>26b73f62-be67-479c-a490-d45667b63052</serial>
Nov 27 23:31:36 user nova-compute[75621]:     </disk>
Nov 27 23:31:36 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:31:36 user nova-compute[75621]:       <mac address="fa:16:3e:c6:6e:c5"/>
Nov 27 23:31:36 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:31:36 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:31:36 user nova-compute[75621]:       <target dev="tap5033dcd6-80"/>
Nov 27 23:31:36 user nova-compute[75621]:     </interface>
Nov 27 23:31:36 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:31:36 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/d0267acc-43ca-412e-86c1-d55000f76997/console.log" append="off"/>
Nov 27 23:31:36 user nova-compute[75621]:     </serial>
Nov 27 23:31:36 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:31:36 user nova-compute[75621]:     <video>
Nov 27 23:31:36 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:31:36 user nova-compute[75621]:     </video>
Nov 27 23:31:36 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:31:36 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:31:36 user nova-compute[75621]:     </rng>
Nov 27 23:31:36 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:31:36 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:31:36 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:31:36 user nova-compute[75621]:     </memballoon>
Nov 27 23:31:36 user nova-compute[75621]:   </devices>
Nov 27 23:31:36 user nova-compute[75621]: </domain>
Nov 27 23:31:36 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189741647',display_name='tempest-TestVolumeBootPattern-server-189741647',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189741647',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-6jmes9i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:31:28Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d0267acc-43ca-412e-86c1-d55000f76997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG os_vif [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fd81793-c73a-5049-afb8-d384f4643476', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5033dcd6-80, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5033dcd6-80, col_values=(('qos', UUID('8d524f57-77db-46f9-8527-f934851eb1e2')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5033dcd6-80, col_values=(('external_ids', {'iface-id': '5033dcd6-8031-4045-ac54-bd4bb2056dce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:6e:c5', 'vm-uuid': 'd0267acc-43ca-412e-86c1-d55000f76997'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:36 user nova-compute[75621]: INFO os_vif [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80')
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:31:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] No VIF found with MAC fa:16:3e:c6:6e:c5, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:31:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG nova.compute.manager [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] No waiting events found dispatching network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:31:38 user nova-compute[75621]: WARNING nova.compute.manager [req-292e57fc-0974-4687-bad5-a19e73ad3190 req-288ff53e-5552-4245-959b-0b11cdc3405f service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received unexpected event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce for instance with vm_state building and task_state spawning.
Nov 27 23:31:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:31:39 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Instance spawned successfully.
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:39 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:31:40 user nova-compute[75621]: INFO nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Took 4.93 seconds to spawn the instance on the hypervisor.
Nov 27 23:31:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:31:40 user nova-compute[75621]: INFO nova.compute.manager [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Took 12.58 seconds to build instance.
Nov 27 23:31:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:31:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:31:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:31:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:40 user nova-compute[75621]: DEBUG nova.compute.manager [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] No waiting events found dispatching network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:31:40 user nova-compute[75621]: WARNING nova.compute.manager [req-35308585-3493-4948-8385-a19235143cdd req-7ff74a2c-3df7-4eeb-98d8-d46628eeee0e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received unexpected event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce for instance with vm_state active and task_state None.
Nov 27 23:31:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-44e83ec4-5e37-4c34-9923-72321db54f63 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.707s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:31:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:31:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:56 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:31:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:03 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:06 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:11 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:32:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:16 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:32:16 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:32:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8712MB free_disk=25.015201568603516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0267acc-43ca-412e-86c1-d55000f76997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:32:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:32:22 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 8f5d94a5-ab44-4e90-a084-fe73739cd25b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:32:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:26 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:31 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-changed-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.compute.manager [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Refreshing instance network info cache due to event network-changed-2886271f-c305-4634-b80e-e76eb145254b. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] Acquiring lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] Acquired lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Refreshing network info cache for port 2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:32:33 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Ignoring supplied device name: /dev/vdb
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updated VIF entry in instance network info cache for port 2886271f-c305-4634-b80e-e76eb145254b. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG nova.network.neutron [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updating instance_info_cache with network_info: [{"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-b30d89c0-31a3-4cd4-99a5-787ca5b2ab23 req-73570da7-b1ea-4fd4-9dfd-06c6646592ad service nova] Releasing lock "refresh_cache-4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:33 user nova-compute[75621]: INFO nova.compute.manager [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Attaching volume 79b1f2e6-44e0-42f5-8a74-96c38641921a to /dev/vdb
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.utils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf481f70-5473-409e-9f46-73a77b42d28d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd452794-f370-44c1-ac7f-582e9df3d161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e028af7-0d27-468b-96d3-80473257c79c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a14a34-730f-4c94-bfbd-e13e0fb0f39c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:32:34 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:32:34 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1961e09-ec8c-4382-8ba1-bfb31907402f]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG os_brick.utils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updating existing volume attachment record: 75407569-f611-4475-a843-4d62ca504318 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:32:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:36 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpsXYNCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:32:41 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:32:41 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:32:41 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a22a88-fff5-4a1a-9504-bb62e3742bed]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:32:41 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ca9bb3-2d85-40d9-aab6-26aa80a7d25c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a] added
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[220bd66f-8da9-487e-a291-73bec9276e5b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[58df54c2-293d-4591-afba-479f9e853ab0]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpsXYNCa {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PpsXYNCa" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02fcddb-d792-4fcc-818c-86a97af70f95]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PpsXYNCa'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[24945f93-8d05-474d-8235-ce922d776a51]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[999f566d-3082-4b15-9b0f-62813903d6f1]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97d42f3-ae56-4491-a96d-c69d686ab2ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260]
Nov 27 23:32:41 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260] successful.
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3036582-14f4-4537-b79e-b2820f99537f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[66debe9d-148b-4ea7-a8c2-6fd5842f0751]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:32:41 user nova-compute[75621]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)
Nov 27 23:32:41 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] HCTL ('35', '-', '-', 0) found on session 60 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53ab473-6bd5-4274-8da3-9699dfe6e473]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:32:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Searching for a device in session 60 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpsXYNCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23936663337643039', 'path': '/dev/sdd'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936663337643039', 'path': '/dev/sdd'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:32:42 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:32:42 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:32:42 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:32:42 user nova-compute[75621]:   <serial>79b1f2e6-44e0-42f5-8a74-96c38641921a</serial>
Nov 27 23:32:42 user nova-compute[75621]: </disk>
Nov 27 23:32:42 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] No VIF found with MAC fa:16:3e:11:91:86, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6fa10b7-ae04-4296-9789-492fb3a9899e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.960s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:47 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:32:47 user nova-compute[75621]: INFO nova.compute.claims [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Claim successful on node user
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:32:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.policy [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaa302e93e104c97affdb533f20057ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69cbbae0c094d97be29dbdb118da717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:32:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Creating image(s)
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "/opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "/opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "/opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk 1073741824" returned: 0 in 0.053s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Successfully created port: 5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Cannot resize image /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Ensure instance console log exists: /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Successfully updated port: 5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing instance network info cache due to event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:32:49 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.neutron [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Instance network_info: |[{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Start _get_guest_xml network_info=[{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:32:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:32:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1198914346',display_name='tempest-TestStampPattern-server-1198914346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1198914346',id=51,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-luocg7pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:32:48Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=da6d1f36-db42-45d7-b53a-bb7a9cde6841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'pci_devices' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:32:50 user nova-compute[75621]:   <uuid>da6d1f36-db42-45d7-b53a-bb7a9cde6841</uuid>
Nov 27 23:32:50 user nova-compute[75621]:   <name>instance-00000033</name>
Nov 27 23:32:50 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:32:50 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:32:50 user nova-compute[75621]:   <metadata>
Nov 27 23:32:50 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:32:50 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:name>tempest-TestStampPattern-server-1198914346</nova:name>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:32:50</nova:creationTime>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:32:50 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:32:50 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:owner>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:user uuid="aaa302e93e104c97affdb533f20057ff">tempest-TestStampPattern-1043636858-project-member</nova:user>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:project uuid="c69cbbae0c094d97be29dbdb118da717">tempest-TestStampPattern-1043636858</nova:project>
Nov 27 23:32:50 user nova-compute[75621]:       </nova:owner>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:32:50 user nova-compute[75621]:       <nova:ports>
Nov 27 23:32:50 user nova-compute[75621]:         <nova:port uuid="5f3c1226-c248-4794-9fbd-d5852b11b1e3">
Nov 27 23:32:50 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 27 23:32:50 user nova-compute[75621]:         </nova:port>
Nov 27 23:32:50 user nova-compute[75621]:       </nova:ports>
Nov 27 23:32:50 user nova-compute[75621]:     </nova:instance>
Nov 27 23:32:50 user nova-compute[75621]:   </metadata>
Nov 27 23:32:50 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:32:50 user nova-compute[75621]:     <system>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="serial">da6d1f36-db42-45d7-b53a-bb7a9cde6841</entry>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="uuid">da6d1f36-db42-45d7-b53a-bb7a9cde6841</entry>
Nov 27 23:32:50 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:32:50 user nova-compute[75621]:     </system>
Nov 27 23:32:50 user nova-compute[75621]:   </sysinfo>
Nov 27 23:32:50 user nova-compute[75621]:   <os>
Nov 27 23:32:50 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:32:50 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:32:50 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:32:50 user nova-compute[75621]:   </os>
Nov 27 23:32:50 user nova-compute[75621]:   <features>
Nov 27 23:32:50 user nova-compute[75621]:     <acpi/>
Nov 27 23:32:50 user nova-compute[75621]:     <apic/>
Nov 27 23:32:50 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:32:50 user nova-compute[75621]:   </features>
Nov 27 23:32:50 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:32:50 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:32:50 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:32:50 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:32:50 user nova-compute[75621]:   </clock>
Nov 27 23:32:50 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:32:50 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:32:50 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:32:50 user nova-compute[75621]:   </cpu>
Nov 27 23:32:50 user nova-compute[75621]:   <devices>
Nov 27 23:32:50 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:32:50 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:32:50 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk"/>
Nov 27 23:32:50 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:32:50 user nova-compute[75621]:     </disk>
Nov 27 23:32:50 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:32:50 user nova-compute[75621]:       <mac address="fa:16:3e:94:d8:e9"/>
Nov 27 23:32:50 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:32:50 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:32:50 user nova-compute[75621]:       <target dev="tap5f3c1226-c2"/>
Nov 27 23:32:50 user nova-compute[75621]:     </interface>
Nov 27 23:32:50 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:32:50 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/console.log" append="off"/>
Nov 27 23:32:50 user nova-compute[75621]:     </serial>
Nov 27 23:32:50 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:32:50 user nova-compute[75621]:     <video>
Nov 27 23:32:50 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:32:50 user nova-compute[75621]:     </video>
Nov 27 23:32:50 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:32:50 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:32:50 user nova-compute[75621]:     </rng>
Nov 27 23:32:50 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:32:50 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:32:50 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:32:50 user nova-compute[75621]:     </memballoon>
Nov 27 23:32:50 user nova-compute[75621]:   </devices>
Nov 27 23:32:50 user nova-compute[75621]: </domain>
Nov 27 23:32:50 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1198914346',display_name='tempest-TestStampPattern-server-1198914346',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1198914346',id=51,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-luocg7pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:32:48Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=da6d1f36-db42-45d7-b53a-bb7a9cde6841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG os_vif [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8e2d833-76d3-52d4-8607-59845b7024fd', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f3c1226-c2, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f3c1226-c2, col_values=(('qos', UUID('20eee11a-3857-4f5f-a97e-ac1108c409c1')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f3c1226-c2, col_values=(('external_ids', {'iface-id': '5f3c1226-c248-4794-9fbd-d5852b11b1e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:d8:e9', 'vm-uuid': 'da6d1f36-db42-45d7-b53a-bb7a9cde6841'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:50 user nova-compute[75621]: INFO os_vif [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2')
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No VIF found with MAC fa:16:3e:94:d8:e9, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated VIF entry in instance network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG nova.network.neutron [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:32:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-47ec7d1d-734c-41fa-aeac-3e719b04a82d req-eb1b4f01-1e92-46be-a279-5cbbf93b7283 service nova] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] No waiting events found dispatching network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:32:51 user nova-compute[75621]: WARNING nova.compute.manager [req-4b00e659-c97e-4abc-8912-0decd616d7e7 req-c0b7c2fa-e7df-435b-92cd-2edb00f25c0b service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received unexpected event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 for instance with vm_state building and task_state spawning.
Nov 27 23:32:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:32:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Instance spawned successfully.
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:32:53 user nova-compute[75621]: INFO nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:32:53 user nova-compute[75621]: INFO nova.compute.manager [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Took 6.00 seconds to build instance.
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:53 user nova-compute[75621]: DEBUG nova.compute.manager [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] No waiting events found dispatching network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:32:53 user nova-compute[75621]: WARNING nova.compute.manager [req-515a14ad-18b0-4aaf-a687-5013934e8cd4 req-b4d07695-65eb-4960-8d87-2099f32ce508 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received unexpected event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 for instance with vm_state active and task_state None.
Nov 27 23:32:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bb42515b-93bc-44ee-84b8-dfe4c863f008 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.116s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:32:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:32:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:00 user nova-compute[75621]: INFO nova.compute.manager [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Detaching volume 79b1f2e6-44e0-42f5-8a74-96c38641921a
Nov 27 23:33:00 user nova-compute[75621]: INFO nova.virt.block_device [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Attempting to driver detach volume 79b1f2e6-44e0-42f5-8a74-96c38641921a from mountpoint /dev/vdb
Nov 27 23:33:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Attempting to detach device vdb from instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:33:00 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:33:00 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:33:00 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:33:00 user nova-compute[75621]:   <serial>79b1f2e6-44e0-42f5-8a74-96c38641921a</serial>
Nov 27 23:33:00 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:33:00 user nova-compute[75621]: </disk>
Nov 27 23:33:00 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:33:00 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully detached device vdb from instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd from the persistent domain config.
Nov 27 23:33:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:33:00 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:33:00 user nova-compute[75621]:   <source dev="/dev/sdd"/>
Nov 27 23:33:00 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:33:00 user nova-compute[75621]:   <serial>79b1f2e6-44e0-42f5-8a74-96c38641921a</serial>
Nov 27 23:33:00 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:33:00 user nova-compute[75621]: </disk>
Nov 27 23:33:00 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:00 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:33:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:05 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:12 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:33:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:15 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:16 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:33:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8563MB free_disk=24.983844757080078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance d0267acc-43ca-412e-86c1-d55000f76997 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:33:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing instance network info cache due to event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] Acquiring lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] Acquired lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updated VIF entry in instance network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating instance_info_cache with network_info: [{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2c3a66e1-cf31-4433-95d5-df45b93bc2a6 req-f2d1fd5e-ac0c-4a0a-a107-5ccdd3ba6fda service nova] Releasing lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.compute.manager [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing instance network info cache due to event network-changed-5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] Acquiring lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] Acquired lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.network.neutron [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Refreshing network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:19 user nova-compute[75621]: INFO nova.compute.manager [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Terminating instance
Nov 27 23:33:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updated VIF entry in instance network info cache for port 5033dcd6-8031-4045-ac54-bd4bb2056dce. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.network.neutron [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating instance_info_cache with network_info: [{"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71332b89-d3e5-4362-8e65-ec6bfad38fdd req-b69b02af-dc62-4dce-9bc2-b83161f652e4 service nova] Releasing lock "refresh_cache-d0267acc-43ca-412e-86c1-d55000f76997" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:20 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd is timed out.
Nov 27 23:33:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully detached device vdb from instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd from the live domain config.
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpsXYNCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:33:20 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72665c0-153e-4fc4-9ea3-194a2123a425]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:33:20 user nova-compute[75621]: No targets found.
Nov 27 23:33:20 user nova-compute[75621]: iSNS:
Nov 27 23:33:20 user nova-compute[75621]: No targets found.
Nov 27 23:33:20 user nova-compute[75621]: STATIC:
Nov 27 23:33:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a
Nov 27 23:33:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:33:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:20 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052
Nov 27 23:33:20 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:20 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:20 user nova-compute[75621]: FIRMWARE:
Nov 27 23:33:20 user nova-compute[75621]: No targets found.
Nov 27 23:33:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:33:20 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:33:20 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Instance destroyed successfully.
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid d0267acc-43ca-412e-86c1-d55000f76997 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[27421ac6-42f9-488f-964d-3347a01fe1e1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:31:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-189741647',display_name='tempest-TestVolumeBootPattern-server-189741647',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-189741647',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:31:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-6jmes9i6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:31:40Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=d0267acc-43ca-412e-86c1-d55000f76997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "address": "fa:16:3e:c6:6e:c5", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5033dcd6-80", "ovs_interfaceid": "5033dcd6-8031-4045-ac54-bd4bb2056dce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_vif [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5033dcd6-80, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618b14c-079c-4694-814e-550e62d62473]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:20 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:33:20 user nova-compute[75621]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)
Nov 27 23:33:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:20 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:33:20 user nova-compute[75621]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a (non-flash)
Nov 27 23:33:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e07ba0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a'): ({'sdd'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Removing single pathed devices sdd {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d524f57-77db-46f9-8527-f934851eb1e2) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:20 user nova-compute[75621]: INFO os_vif [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:6e:c5,bridge_name='br-int',has_traffic_filtering=True,id=5033dcd6-8031-4045-ac54-bd4bb2056dce,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5033dcd6-80')
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JKPFBmZL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:33:20 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c941fc70-7b31-4b8b-9e81-5b2120ea5bdb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f8376-e3c1-4368-92a6-a3b090107a3d]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Flushing IO for device /dev/sdd {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[058a43b9-a5da-4513-9634-0b2a9eacd80a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fcf4ca-f4c9-47fc-9772-8d5b3139f39f]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] SCSI volumes sdd have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1053b5f4-c0d1-4d4a-a0ac-21881f3c9771]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4171491-f7e5-4146-9fe1-82c3d5aa60d9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260]
Nov 27 23:33:20 user nova-compute[75621]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a, portal: 172.16.0.220,3260] successful.
Nov 27 23:33:20 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f52e8b-0d9f-4e36-a3ef-c4fbf142e673]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== disconnect_volume: return (308ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:33:20 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.203s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecdfa0-86d5-412d-9ebb-16e6e19fd15c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:33:21 user nova-compute[75621]: No targets found.
Nov 27 23:33:21 user nova-compute[75621]: iSNS:
Nov 27 23:33:21 user nova-compute[75621]: No targets found.
Nov 27 23:33:21 user nova-compute[75621]: STATIC:
Nov 27 23:33:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:33:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:21 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052
Nov 27 23:33:21 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:21 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:21 user nova-compute[75621]: FIRMWARE:
Nov 27 23:33:21 user nova-compute[75621]: No targets found.
Nov 27 23:33:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:33:21 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:33:21 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0334c7d-9411-4bb1-9f1b-a8af7c885cbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6508d92-f80f-4fac-8a15-eb5b547e359f]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:21 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:33:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:21 user nova-compute[75621]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 (non-flash)
Nov 27 23:33:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e06e6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c9a92-4265-4cef-a18a-9fd43c113dde]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c263d6-9bdb-4205-841c-5f8519a2aa6d]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccac9378-0962-4a62-9ea7-b340f86be0a9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-unplugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] No waiting events found dispatching network-vif-unplugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-unplugged-5033dcd6-8031-4045-ac54-bd4bb2056dce for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Acquiring lock "d0267acc-43ca-412e-86c1-d55000f76997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] Lock "d0267acc-43ca-412e-86c1-d55000f76997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] No waiting events found dispatching network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:33:21 user nova-compute[75621]: WARNING nova.compute.manager [req-7fbfa2aa-eaee-49fc-aecc-7c91554c4a60 req-00ba5836-4a43-4095-b41f-a7acc593b66e service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received unexpected event network-vif-plugged-5033dcd6-8031-4045-ac54-bd4bb2056dce for instance with vm_state active and task_state deleting.
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd455fea-4686-45fe-b99f-987287201e32]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc4332-def6-436e-8c61-e14f13a2a32f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[73685a29-7976-489d-bf2f-765383e81fee]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260]
Nov 27 23:33:21 user nova-compute[75621]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052, portal: 172.16.0.220,3260] successful.
Nov 27 23:33:21 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b73f62-be67-479c-a490-d45667b63052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b29e1-1347-4aad-bb9d-b65caaf2837f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (498ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:33:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Deleting instance files /opt/stack/data/nova/instances/d0267acc-43ca-412e-86c1-d55000f76997_del
Nov 27 23:33:21 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Deletion of /opt/stack/data/nova/instances/d0267acc-43ca-412e-86c1-d55000f76997_del complete
Nov 27 23:33:21 user nova-compute[75621]: INFO nova.compute.manager [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Took 1.36 seconds to destroy the instance on the hypervisor.
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.objects.instance [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'flavor' on Instance uuid 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-66696cc6-c0c8-43c8-9f7a-a7fcbd09ea2e tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.724s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.582s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:21 user nova-compute[75621]: INFO nova.compute.manager [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Terminating instance
Nov 27 23:33:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:21 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-unplugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] No waiting events found dispatching network-vif-unplugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-1c46a707-56d9-41f1-b786-f043a18855b0 req-1a8c4e1f-16fa-4933-b84f-2ca3df483262 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-unplugged-2886271f-c305-4634-b80e-e76eb145254b for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:33:22 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Took 0.98 seconds to deallocate network for instance.
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.compute.manager [req-932d3367-2b5a-4577-b139-6447fe625e86 req-2adf9b6c-4729-4877-a7ee-563a10e7eef2 service nova] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Received event network-vif-deleted-5033dcd6-8031-4045-ac54-bd4bb2056dce {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Instance destroyed successfully.
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.objects.instance [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lazy-loading 'resources' on Instance uuid 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:30:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1005587619',display_name='tempest-VolumesSnapshotTestJSON-instance-1005587619',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1005587619',id=49,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOfkyX9WXLQ/fIJbcVA/hJ26xRs2tYUnr8mLve/RPEaC69JCS2ujIhdlkWZi+A1YfGmTDIuwZ7zhIxvqURLk3bSmuPk5LWY1JtHl/WbMts1jXaEPDmqwJcclwh+I5i7rw==',key_name='tempest-keypair-431697498',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:30:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8803295cb17944c5b2457facfbbbf5fd',ramdisk_id='',reservation_id='r-caphuv6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1370947947',owner_user_name='tempest-VolumesSnapshotTestJSON-1370947947-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='69bb978f984e4b6eac393c6d879d5f20',uuid=4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converting VIF {"id": "2886271f-c305-4634-b80e-e76eb145254b", "address": "fa:16:3e:11:91:86", "network": {"id": "24aec6c6-d739-458b-a4c4-e80223d721c6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1991299743-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8803295cb17944c5b2457facfbbbf5fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2886271f-c3", "ovs_interfaceid": "2886271f-c305-4634-b80e-e76eb145254b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_vif [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2886271f-c3, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de1e4975-de68-4460-b45c-ca69e6f7e812) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:22 user nova-compute[75621]: INFO os_vif [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:91:86,bridge_name='br-int',has_traffic_filtering=True,id=2886271f-c305-4634-b80e-e76eb145254b,network=Network(24aec6c6-d739-458b-a4c4-e80223d721c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2886271f-c3')
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PpsXYNCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:33:22 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7473ea29-2fc5-484a-af0a-f6366efd92c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:33:22 user nova-compute[75621]: No targets found.
Nov 27 23:33:22 user nova-compute[75621]: iSNS:
Nov 27 23:33:22 user nova-compute[75621]: No targets found.
Nov 27 23:33:22 user nova-compute[75621]: STATIC:
Nov 27 23:33:22 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:33:22 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:33:22 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:33:22 user nova-compute[75621]: FIRMWARE:
Nov 27 23:33:22 user nova-compute[75621]: No targets found.
Nov 27 23:33:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:33:22 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:33:22 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79b1f2e6-44e0-42f5-8a74-96c38641921a', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20611f-642b-4e5f-8ea4-c37ae0bbc8dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b25bf8e-3054-4124-8cb6-a372d946a9bc]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:33:22 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13040e1510>, {}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Disconnecting from: [] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] <== disconnect_volume: return (66ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:33:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Deleting instance files /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd_del
Nov 27 23:33:22 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Deletion of /opt/stack/data/nova/instances/4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd_del complete
Nov 27 23:33:22 user nova-compute[75621]: INFO nova.compute.manager [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 27 23:33:22 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:33:22 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:33:23 user nova-compute[75621]: INFO nova.compute.manager [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: d0267acc-43ca-412e-86c1-d55000f76997] Took 0.74 seconds to detach 1 volumes for instance.
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:23 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance d0267acc-43ca-412e-86c1-d55000f76997
Nov 27 23:33:23 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:33:23 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Took 0.70 seconds to deallocate network for instance.
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d12782fa-912b-4275-9948-3f508a9743d5 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "d0267acc-43ca-412e-86c1-d55000f76997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.458s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:23 user nova-compute[75621]: WARNING nova.volume.cinder [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Attachment 75407569-f611-4475-a843-4d62ca504318 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 75407569-f611-4475-a843-4d62ca504318. (HTTP 404) (Request-ID: req-7475f115-49af-49b1-aa10-70d8fdd9ced6)
Nov 27 23:33:23 user nova-compute[75621]: INFO nova.compute.manager [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Took 0.03 seconds to detach 1 volumes for instance.
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:23 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Deleted allocations for instance 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd
Nov 27 23:33:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-856c3148-e55c-4bf7-af62-ea70a95b3249 tempest-VolumesSnapshotTestJSON-1370947947 tempest-VolumesSnapshotTestJSON-1370947947-project-member] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.008s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] Acquiring lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] Lock "4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] No waiting events found dispatching network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:33:24 user nova-compute[75621]: WARNING nova.compute.manager [req-56a2a610-43e2-4284-93f7-c167c76f5337 req-11a3718e-bc39-4723-a14c-735c7a0a0668 service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received unexpected event network-vif-plugged-2886271f-c305-4634-b80e-e76eb145254b for instance with vm_state deleted and task_state None.
Nov 27 23:33:24 user nova-compute[75621]: DEBUG nova.compute.manager [req-0b99d1cd-78e1-4452-9c2e-b47f9372cbe7 req-9c3768de-6e64-4536-bf25-2988ceb5ad4b service nova] [instance: 4d12d2a3-bb09-4cd0-ac9d-9facf32e9fdd] Received event network-vif-deleted-2886271f-c305-4634-b80e-e76eb145254b {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:33:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:33:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:33:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:33:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:33:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:34:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:34:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:16 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:16 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:34:17 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8860MB free_disk=25.001880645751953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:34:17 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing instance network info cache due to event network-changed-8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] Acquiring lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] Acquired lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Refreshing network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:18 user nova-compute[75621]: INFO nova.compute.manager [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Terminating instance
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-unplugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] No waiting events found dispatching network-vif-unplugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.compute.manager [req-5ad09318-4648-4ce2-ac42-fee899855b7a req-496fbfaa-e63e-487f-9df7-d8784e1f9bf8 service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-unplugged-8d613078-9619-48fa-9f6d-4d4224fd9824 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updated VIF entry in instance network info cache for port 8d613078-9619-48fa-9f6d-4d4224fd9824. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.network.neutron [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [{"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-71d128ce-95cf-4fe2-830b-dc2332cf3821 req-59f45b1f-5aea-48f1-8a64-5c78ec794cae service nova] Releasing lock "refresh_cache-8f5d94a5-ab44-4e90-a084-fe73739cd25b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:34:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Instance destroyed successfully.
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lazy-loading 'resources' on Instance uuid 8f5d94a5-ab44-4e90-a084-fe73739cd25b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:29:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-18266476',display_name='tempest-TestVolumeBootPattern-server-18266476',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-18266476',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3yz0WozsoVJtPjvNe7gIjM9/Gkboo6q4mrfmcVEzjxh+zaDoasITNxzEVNh3Dsmhts0iUwHzpsT6LWWijX6nxPxntuGAyk5o8dr/njhDEKsz6sh1yWDUC7aou5UgT/QA==',key_name='tempest-TestVolumeBootPattern-266706348',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:29:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c394c68191644ed9f8a5e071b7b55dc',ramdisk_id='',reservation_id='r-r6eowe0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-11911166',owner_user_name='tempest-TestVolumeBootPattern-11911166-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:29:42Z,user_data=None,user_id='b3a15c55aeca4eb8a0327957fd5d38b9',uuid=8f5d94a5-ab44-4e90-a084-fe73739cd25b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converting VIF {"id": "8d613078-9619-48fa-9f6d-4d4224fd9824", "address": "fa:16:3e:04:c3:fc", "network": {"id": "62b318c0-2dc8-428c-b8d0-ad70783b8b37", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1011290201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c394c68191644ed9f8a5e071b7b55dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d613078-96", "ovs_interfaceid": "8d613078-9619-48fa-9f6d-4d4224fd9824", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG os_vif [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d613078-96, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb10569e-481b-4f56-8fb0-d09e6576476c) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:18 user nova-compute[75621]: INFO os_vif [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:c3:fc,bridge_name='br-int',has_traffic_filtering=True,id=8d613078-9619-48fa-9f6d-4d4224fd9824,network=Network(62b318c0-2dc8-428c-b8d0-ad70783b8b37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d613078-96')
Nov 27 23:34:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TFJnmrGx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:34:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:34:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:34:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aae1964-b5ab-46bd-af42-dc175dbb6a49]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:34:19 user nova-compute[75621]: No targets found.
Nov 27 23:34:19 user nova-compute[75621]: iSNS:
Nov 27 23:34:19 user nova-compute[75621]: No targets found.
Nov 27 23:34:19 user nova-compute[75621]: STATIC:
Nov 27 23:34:19 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7
Nov 27 23:34:19 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:34:19 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:34:19 user nova-compute[75621]: FIRMWARE:
Nov 27 23:34:19 user nova-compute[75621]: No targets found.
Nov 27 23:34:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:34:19 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:34:19 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d48698-9717-493b-9c2a-1bff6b132b37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a84a0f-228b-4452-b6c2-22e0c489f77d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:34:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 (non-flash)
Nov 27 23:34:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130018cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7'): ({'sdc'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Removing single pathed devices sdc {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d40b381-1ef4-4e3c-b326-1ec70042c5e8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcda589d-56dc-4dc4-9157-ee13c75cc5f1]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Flushing IO for device /dev/sdc {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cc0ebe-5f21-40b1-81ee-e3c60f023e63]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc6694-f6e8-4956-9b7b-ed01f8cf1505]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] SCSI volumes sdc have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60dfe40-6dce-471a-a77d-f0d20ce9a24b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[86edaae6-fa71-490d-8f97-01ced90a9095]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260]
Nov 27 23:34:19 user nova-compute[75621]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7, portal: 172.16.0.220,3260] successful.
Nov 27 23:34:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d8c4141-da96-49d0-b650-88647ef8e5e7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c7deda-d3b7-42d9-8f1d-a15a5c463c69]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] <== disconnect_volume: return (294ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:34:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Deleting instance files /opt/stack/data/nova/instances/8f5d94a5-ab44-4e90-a084-fe73739cd25b_del
Nov 27 23:34:19 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Deletion of /opt/stack/data/nova/instances/8f5d94a5-ab44-4e90-a084-fe73739cd25b_del complete
Nov 27 23:34:19 user nova-compute[75621]: INFO nova.compute.manager [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 27 23:34:19 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:34:19 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:34:20 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Took 0.66 seconds to deallocate network for instance.
Nov 27 23:34:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] Acquiring lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] No waiting events found dispatching network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:34:20 user nova-compute[75621]: WARNING nova.compute.manager [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received unexpected event network-vif-plugged-8d613078-9619-48fa-9f6d-4d4224fd9824 for instance with vm_state active and task_state deleting.
Nov 27 23:34:20 user nova-compute[75621]: DEBUG nova.compute.manager [req-c9372e62-837d-4cf0-b507-cbaea495cbb7 req-f7fc3e36-e0e2-4292-88d6-e2406526c5de service nova] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Received event network-vif-deleted-8d613078-9619-48fa-9f6d-4d4224fd9824 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:34:20 user nova-compute[75621]: INFO nova.compute.manager [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] [instance: 8f5d94a5-ab44-4e90-a084-fe73739cd25b] Took 0.76 seconds to detach 1 volumes for instance.
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:34:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.144s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:21 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Deleted allocations for instance 8f5d94a5-ab44-4e90-a084-fe73739cd25b
Nov 27 23:34:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-1c602c8d-12e7-4908-9419-b00e50fcb815 tempest-TestVolumeBootPattern-11911166 tempest-TestVolumeBootPattern-11911166-project-member] Lock "8f5d94a5-ab44-4e90-a084-fe73739cd25b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.923s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:34:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:34:24 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:34:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:34:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:34:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:34:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:34:39 user nova-compute[75621]: DEBUG nova.compute.manager [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing instance network info cache due to event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:34:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:34:39 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:34:39 user nova-compute[75621]: DEBUG nova.network.neutron [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:34:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated VIF entry in instance network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:34:40 user nova-compute[75621]: DEBUG nova.network.neutron [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:34:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-03d3bb7c-fa35-4438-b176-369f4d331517 req-fef2f0e5-6260-4e51-8f67-575d428d1f54 service nova] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:41 user nova-compute[75621]: INFO nova.compute.manager [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Attaching volume d88665f3-fdf9-404c-a95d-97cc3d885e93 to /dev/vdb
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.utils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db6c84b-c619-4cb5-9be1-f4175d61fe70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15e306d-962b-4a0d-8d21-bfbdd54f7f20]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f645fc-6553-4655-8384-bb9aa70bfe25]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[65882fb5-4a48-4c74-8e09-81e7355e1039]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:34:41 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:34:41 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e84424-df1f-4673-8e3c-c5a138b8c6c2]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG os_brick.utils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:34:41 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating existing volume attachment record: cf8f6dcb-4516-493b-a584-31b669845fd0 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:34:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:34:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwQIFAod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:34:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:34:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:34:48 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff62c90-701a-4218-bbf9-a9af8549b575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:34:48 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b64a5d-e075-48fd-8911-c21baec05cbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93] added
Nov 27 23:34:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c525e8-3bb4-46dc-8188-b4af3a746692]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4fc042-2892-4e41-a49b-6199c1b61591]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwQIFAod {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lwQIFAod" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd183bc-0b09-4ef4-928c-4eff662551f6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lwQIFAod'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a6500e-dfea-449e-9629-463db6b3b6b5]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b7bd30-91da-4655-8c51-0a3c5b4159f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:34:48 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:34:48 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:34:48 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:34:48 user nova-compute[75621]: 
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe17f97-9f46-4550-943c-5a87ea8a0447]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260]
Nov 27 23:34:48 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260] successful.
Nov 27 23:34:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e455282-75ff-4b4b-90a7-2b192cbffd69]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8db6e-e916-4a11-b378-69ac3384355f]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)
Nov 27 23:34:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)
Nov 27 23:34:48 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33646c-2b54-4c3c-a1b7-108bf7004627]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:34:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwQIFAod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23761336663613365', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23761336663613365', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:34:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:34:49 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:34:49 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:34:49 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:34:49 user nova-compute[75621]:   <serial>d88665f3-fdf9-404c-a95d-97cc3d885e93</serial>
Nov 27 23:34:49 user nova-compute[75621]: </disk>
Nov 27 23:34:49 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:34:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:34:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:34:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No VIF found with MAC fa:16:3e:94:d8:e9, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:34:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-dcbc96eb-2f90-499a-b0c6-00d18583c8d2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.960s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:34:53 user nova-compute[75621]: INFO nova.compute.manager [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Detaching volume d88665f3-fdf9-404c-a95d-97cc3d885e93
Nov 27 23:34:53 user nova-compute[75621]: INFO nova.virt.block_device [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Attempting to driver detach volume d88665f3-fdf9-404c-a95d-97cc3d885e93 from mountpoint /dev/vdb
Nov 27 23:34:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Attempting to detach device vdb from instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:34:53 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:34:53 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:34:53 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:34:53 user nova-compute[75621]:   <serial>d88665f3-fdf9-404c-a95d-97cc3d885e93</serial>
Nov 27 23:34:53 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:34:53 user nova-compute[75621]: </disk>
Nov 27 23:34:53 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:34:53 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully detached device vdb from instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 from the persistent domain config.
Nov 27 23:34:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:34:53 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:34:53 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:34:53 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:34:53 user nova-compute[75621]:   <serial>d88665f3-fdf9-404c-a95d-97cc3d885e93</serial>
Nov 27 23:34:53 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:34:53 user nova-compute[75621]: </disk>
Nov 27 23:34:53 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:34:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:34:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:13 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 is timed out.
Nov 27 23:35:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully detached device vdb from instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 from the live domain config.
Nov 27 23:35:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lwQIFAod', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:35:13 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f960a51-92ca-48a2-8d26-7f0a60eb9302]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:35:13 user nova-compute[75621]: No targets found.
Nov 27 23:35:13 user nova-compute[75621]: iSNS:
Nov 27 23:35:13 user nova-compute[75621]: No targets found.
Nov 27 23:35:13 user nova-compute[75621]: STATIC:
Nov 27 23:35:13 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93
Nov 27 23:35:13 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:35:13 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:35:13 user nova-compute[75621]: FIRMWARE:
Nov 27 23:35:13 user nova-compute[75621]: No targets found.
Nov 27 23:35:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:35:13 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:35:13 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2f3c93-e374-4368-aa97-a0d0cc1b7fcf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4429630-4582-4cba-8c5a-e5206a746f8e]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)
Nov 27 23:35:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 (non-flash)
Nov 27 23:35:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05a39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21088e2-604d-4d19-83f1-249aa6d3dc52]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92781959-733e-4860-b78b-ad0929d4c1d1]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef446df2-fd6b-49ff-835c-6f43ec5ea2f3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a25260-cc6b-418a-a584-34fa8ccffd75]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00930b8-e31e-4a58-8b3b-aec4d998079e]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f0a371-e6d6-4bda-be63-36d7d3320bbc]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260]
Nov 27 23:35:13 user nova-compute[75621]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93, portal: 172.16.0.220,3260] successful.
Nov 27 23:35:13 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d88665f3-fdf9-404c-a95d-97cc3d885e93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdf64e2-c89a-4312-b7fa-2befd7f55e4a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== disconnect_volume: return (292ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:35:13 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG nova.objects.instance [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-cb209474-139b-472d-b94c-aa80abd92cab tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.679s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:15 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:35:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:18 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:19 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:35:19 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8976MB free_disk=24.998672485351562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:35:19 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:35:20 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:35:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:35:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:35:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:35:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:35:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:47 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:35:47 user nova-compute[75621]: INFO nova.compute.manager [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] instance snapshotting
Nov 27 23:35:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Beginning live snapshot process
Nov 27 23:35:47 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json -f qcow2 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf.delta 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf.delta 1073741824" returned: 0 in 0.047s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:48 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 27 23:35:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:35:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75621) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 27 23:35:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 27 23:35:49 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:35:49 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf.delta /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf.delta /opt/stack/data/nova/instances/snapshots/tmpu7cqmbxz/d966023990654554899b63e6b770f8bf" returned: 0 in 0.534s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Snapshot extracted, beginning image upload
Nov 27 23:35:52 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Snapshot image upload complete
Nov 27 23:35:52 user nova-compute[75621]: INFO nova.compute.manager [None req-d7fe0321-c12d-47cc-9eda-a94520e3bd96 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Took 5.15 seconds to snapshot the instance on the hypervisor.
Nov 27 23:35:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:35:55 user nova-compute[75621]: INFO nova.compute.claims [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Claim successful on node user
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.204s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:35:55 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:35:55 user nova-compute[75621]: DEBUG nova.policy [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaa302e93e104c97affdb533f20057ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c69cbbae0c094d97be29dbdb118da717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:35:56 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Creating image(s)
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "/opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "/opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.part --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Successfully created port: b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG nova.virt.images [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] 0a9932d4-2b73-43a8-bf4d-3a70227ae451 was qcow2, converting to raw {{(pid=75621) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG nova.privsep.utils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75621) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 27 23:35:56 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.part /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.converted {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.part /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.converted" returned: 0 in 0.270s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.converted --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.405s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json" returned: 0 in 0.179s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Successfully updated port: b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquired lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG nova.compute.manager [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing instance network info cache due to event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] Acquiring lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json" returned: 0 in 0.166s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403,backing_fmt=raw /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403,backing_fmt=raw /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk 1073741824" returned: 0 in 0.048s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "c3113a3893551d3bc466331fa87a0c6b8e0e5403" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:57 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Ensure instance console log exists: /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.neutron [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Releasing lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Instance network_info: |[{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] Acquired lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Start _get_guest_xml network_info=[{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='8cc59002a201d64963f22436e78a9f7a',container_format='bare',created_at=2023-11-27T23:35:47Z,direct_url=<?>,disk_format='qcow2',id=0a9932d4-2b73-43a8-bf4d-3a70227ae451,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-138671574',owner='c69cbbae0c094d97be29dbdb118da717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T23:35:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '0a9932d4-2b73-43a8-bf4d-3a70227ae451'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:35:58 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:35:58 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='8cc59002a201d64963f22436e78a9f7a',container_format='bare',created_at=2023-11-27T23:35:47Z,direct_url=<?>,disk_format='qcow2',id=0a9932d4-2b73-43a8-bf4d-3a70227ae451,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-138671574',owner='c69cbbae0c094d97be29dbdb118da717',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-27T23:35:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1285787804',display_name='tempest-TestStampPattern-server-1285787804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1285787804',id=52,image_ref='0a9932d4-2b73-43a8-bf4d-3a70227ae451',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-e9vzwfqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da6d1f36-db42-45d7-b53a-bb7a9cde6841',image_min_disk='1',image_min_ram='0',image_owner_id='c69cbbae0c094d97be29dbdb118da717',image_owner_project_name='tempest-TestStampPattern-1043636858',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1043636858-project-member',image_user_id='aaa302e93e104c97affdb533f20057ff',network_allocated='True',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:35:56Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=5e1ed289-c656-4584-8507-efb7c21aff7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.objects.instance [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:35:58 user nova-compute[75621]:   <uuid>5e1ed289-c656-4584-8507-efb7c21aff7d</uuid>
Nov 27 23:35:58 user nova-compute[75621]:   <name>instance-00000034</name>
Nov 27 23:35:58 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:35:58 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:35:58 user nova-compute[75621]:   <metadata>
Nov 27 23:35:58 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:35:58 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:name>tempest-TestStampPattern-server-1285787804</nova:name>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:35:58</nova:creationTime>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:35:58 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:35:58 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:owner>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:user uuid="aaa302e93e104c97affdb533f20057ff">tempest-TestStampPattern-1043636858-project-member</nova:user>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:project uuid="c69cbbae0c094d97be29dbdb118da717">tempest-TestStampPattern-1043636858</nova:project>
Nov 27 23:35:58 user nova-compute[75621]:       </nova:owner>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:root type="image" uuid="0a9932d4-2b73-43a8-bf4d-3a70227ae451"/>
Nov 27 23:35:58 user nova-compute[75621]:       <nova:ports>
Nov 27 23:35:58 user nova-compute[75621]:         <nova:port uuid="b07e18ee-cf49-4966-9ae1-8916e755df63">
Nov 27 23:35:58 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 27 23:35:58 user nova-compute[75621]:         </nova:port>
Nov 27 23:35:58 user nova-compute[75621]:       </nova:ports>
Nov 27 23:35:58 user nova-compute[75621]:     </nova:instance>
Nov 27 23:35:58 user nova-compute[75621]:   </metadata>
Nov 27 23:35:58 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:35:58 user nova-compute[75621]:     <system>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="serial">5e1ed289-c656-4584-8507-efb7c21aff7d</entry>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="uuid">5e1ed289-c656-4584-8507-efb7c21aff7d</entry>
Nov 27 23:35:58 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:35:58 user nova-compute[75621]:     </system>
Nov 27 23:35:58 user nova-compute[75621]:   </sysinfo>
Nov 27 23:35:58 user nova-compute[75621]:   <os>
Nov 27 23:35:58 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:35:58 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:35:58 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:35:58 user nova-compute[75621]:   </os>
Nov 27 23:35:58 user nova-compute[75621]:   <features>
Nov 27 23:35:58 user nova-compute[75621]:     <acpi/>
Nov 27 23:35:58 user nova-compute[75621]:     <apic/>
Nov 27 23:35:58 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:35:58 user nova-compute[75621]:   </features>
Nov 27 23:35:58 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:35:58 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:35:58 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:35:58 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:35:58 user nova-compute[75621]:   </clock>
Nov 27 23:35:58 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:35:58 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:35:58 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:35:58 user nova-compute[75621]:   </cpu>
Nov 27 23:35:58 user nova-compute[75621]:   <devices>
Nov 27 23:35:58 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:35:58 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:35:58 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk"/>
Nov 27 23:35:58 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:35:58 user nova-compute[75621]:     </disk>
Nov 27 23:35:58 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:35:58 user nova-compute[75621]:       <mac address="fa:16:3e:2e:ba:0f"/>
Nov 27 23:35:58 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:35:58 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:35:58 user nova-compute[75621]:       <target dev="tapb07e18ee-cf"/>
Nov 27 23:35:58 user nova-compute[75621]:     </interface>
Nov 27 23:35:58 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:35:58 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/console.log" append="off"/>
Nov 27 23:35:58 user nova-compute[75621]:     </serial>
Nov 27 23:35:58 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:35:58 user nova-compute[75621]:     <video>
Nov 27 23:35:58 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:35:58 user nova-compute[75621]:     </video>
Nov 27 23:35:58 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:35:58 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:35:58 user nova-compute[75621]:     </rng>
Nov 27 23:35:58 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:35:58 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:35:58 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:35:58 user nova-compute[75621]:     </memballoon>
Nov 27 23:35:58 user nova-compute[75621]:   </devices>
Nov 27 23:35:58 user nova-compute[75621]: </domain>
Nov 27 23:35:58 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1285787804',display_name='tempest-TestStampPattern-server-1285787804',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1285787804',id=52,image_ref='0a9932d4-2b73-43a8-bf4d-3a70227ae451',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-e9vzwfqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da6d1f36-db42-45d7-b53a-bb7a9cde6841',image_min_disk='1',image_min_ram='0',image_owner_id='c69cbbae0c094d97be29dbdb118da717',image_owner_project_name='tempest-TestStampPattern-1043636858',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1043636858-project-member',image_user_id='aaa302e93e104c97affdb533f20057ff',network_allocated='True',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:35:56Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=5e1ed289-c656-4584-8507-efb7c21aff7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG os_vif [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '847ee35e-8ce1-56fb-b05f-78817e7db63b', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb07e18ee-cf, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb07e18ee-cf, col_values=(('qos', UUID('b953ad22-68ac-47a9-98cc-680aaa71230f')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb07e18ee-cf, col_values=(('external_ids', {'iface-id': 'b07e18ee-cf49-4966-9ae1-8916e755df63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:ba:0f', 'vm-uuid': '5e1ed289-c656-4584-8507-efb7c21aff7d'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:58 user nova-compute[75621]: INFO os_vif [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf')
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No VIF found with MAC fa:16:3e:2e:ba:0f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updated VIF entry in instance network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:35:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-cd8a9023-8ab2-409f-a570-a7abbbacb028 req-f1f7859d-f8f2-4e7a-9672-1c4ceb35660d service nova] Releasing lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:35:59 user nova-compute[75621]: DEBUG nova.compute.manager [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] No waiting events found dispatching network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:35:59 user nova-compute[75621]: WARNING nova.compute.manager [req-4f13ce4c-6ab3-4348-ba1a-95b1aa6e0619 req-e04b6d1b-2562-4099-a00f-5cb9d31d751a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received unexpected event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 for instance with vm_state building and task_state spawning.
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:36:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Instance spawned successfully.
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:36:01 user nova-compute[75621]: INFO nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:36:01 user nova-compute[75621]: INFO nova.compute.manager [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Took 6.25 seconds to build instance.
Nov 27 23:36:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-22d009a6-9cc1-4c04-8b4f-834f7ddeb1b2 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.352s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:01 user nova-compute[75621]: DEBUG nova.compute.manager [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] No waiting events found dispatching network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:36:01 user nova-compute[75621]: WARNING nova.compute.manager [req-58f63938-168f-4bde-a904-f83badb29cd1 req-728c2d07-ddae-48b2-8a94-a08aee920131 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received unexpected event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 for instance with vm_state active and task_state None.
Nov 27 23:36:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:07 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:17 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:36:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:36:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:36:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:36:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:20 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:22 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:36:22 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.85269546508789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5e1ed289-c656-4584-8507-efb7c21aff7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:36:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:36:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:36:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:36:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:36:37 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Verify base images {{(pid=75621) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Image id 0a9932d4-2b73-43a8-bf4d-3a70227ae451 yields fingerprint c3113a3893551d3bc466331fa87a0c6b8e0e5403 {{(pid=75621) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] image 0a9932d4-2b73-43a8-bf4d-3a70227ae451 at (/opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403): checking
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] image 0a9932d4-2b73-43a8-bf4d-3a70227ae451 at (/opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403): image is in use {{(pid=75621) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75621) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Image id 6631148d-0ff5-48f2-bd92-4bf6df1a42c4 yields fingerprint 72452afa9e65d6107cc4dd78b04d41f559b68b9f {{(pid=75621) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] image 6631148d-0ff5-48f2-bd92-4bf6df1a42c4 at (/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f): checking
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] image 6631148d-0ff5-48f2-bd92-4bf6df1a42c4 at (/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f): image is in use {{(pid=75621) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] da6d1f36-db42-45d7-b53a-bb7a9cde6841 is a valid instance name {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] da6d1f36-db42-45d7-b53a-bb7a9cde6841 has a disk file {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 is backed by 72452afa9e65d6107cc4dd78b04d41f559b68b9f {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] 5e1ed289-c656-4584-8507-efb7c21aff7d is a valid instance name {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] 5e1ed289-c656-4584-8507-efb7c21aff7d has a disk file {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5e1ed289-c656-4584-8507-efb7c21aff7d is backed by c3113a3893551d3bc466331fa87a0c6b8e0e5403 {{(pid=75621) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273
Nov 27 23:36:38 user nova-compute[75621]: WARNING nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Unknown base file: /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Active base files: /opt/stack/data/nova/instances/_base/c3113a3893551d3bc466331fa87a0c6b8e0e5403 /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Removable base files: /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9 /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6 /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869 /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273 /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01bd98b165c93872c1608d1eb41ee1ebd7bad0e9
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/21a813150daafe8e4749aa78171ea4e686187dca
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f749b71473e9140b8e696986c54c8b4179fc5fe6
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/551c71c3480aa886a073f0e5e54509c9bd386869
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b663489974d44ee609fc93ad4428c2d8a173363e
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5cb47fe0f038e53b71e2c50cb253c603364cc2db
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8754a5de270399fe7b68da276234f4b43944f273
Nov 27 23:36:38 user nova-compute[75621]: INFO nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/47901a02d095a2c92c899fa181e3da6f328ddbe4
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Verification complete {{(pid=75621) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Verify swap images {{(pid=75621) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 27 23:36:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.imagecache [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Verify ephemeral images {{(pid=75621) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 27 23:36:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:36:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:36:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:37:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:37:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:37:20 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:37:20 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:21 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:22 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:37:22 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=24.85175323486328GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5e1ed289-c656-4584-8507-efb7c21aff7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:37:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:37:29 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:37:31 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:37:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:37:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:37:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing instance network info cache due to event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] Acquiring lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] Acquired lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updated VIF entry in instance network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1e17fc22-1174-4c20-a784-84509ef89e60 req-fc02c2f1-7606-446c-80c6-757ba744191a service nova] Releasing lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:37:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:37:48 user nova-compute[75621]: INFO nova.compute.manager [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Attaching volume 12de2d0f-3dbb-446f-8c31-837990bcb8ea to /dev/vdb
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.utils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e378abff-d47a-4811-9717-9e3c7c51a078]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad9bf8a-2bd6-40ac-b62d-c6166c721353]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf875810-03fd-431a-9647-0f99f00fa8dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d095ce-13fa-456d-8523-841bf7b55c53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:37:48 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:37:48 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[72032e15-14ea-487a-8452-66c538293e4c]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG os_brick.utils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:37:48 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating existing volume attachment record: 22b7f606-6c3e-4cb2-bddf-59a7ad60f1d1 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:37:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyWLAYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:37:54 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:37:54 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:37:54 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ced682a-86e4-4bdd-9408-543abf1f69b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:37:54 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bdd9e6-1490-4bc8-b831-e8b9d8c01db9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea] added
Nov 27 23:37:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00651ea5-d7ce-46c5-9fe5-a7b54d0c01f9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f338cb7e-c534-494b-b916-e57a510357cf]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyWLAYB {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lFyWLAYB" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2a6876-802a-40f2-a34f-afb72fe71767]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lFyWLAYB'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6e99d7-5fa8-4f35-a0e0-331cff0e7007]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb32388-44e0-4487-81e2-64403211125e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:37:54 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:37:54 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:37:54 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:37:54 user nova-compute[75621]: 
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9529f912-96ef-4fbf-91b2-47fa1345d202]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260]
Nov 27 23:37:54 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260] successful.
Nov 27 23:37:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[80765162-d15c-4520-9613-c2127ef62c15]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f5b5a8-af7c-40f2-b6ba-449af7088b0a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)
Nov 27 23:37:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)
Nov 27 23:37:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d549b8-9c46-47ea-8436-8a3e54f516fc]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:37:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyWLAYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:37:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:37:55 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26362343030626532', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:37:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362343030626532', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:37:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:37:55 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:37:55 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:37:55 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:37:55 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:37:55 user nova-compute[75621]:   <serial>12de2d0f-3dbb-446f-8c31-837990bcb8ea</serial>
Nov 27 23:37:55 user nova-compute[75621]: </disk>
Nov 27 23:37:55 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:37:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:37:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:37:56 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] No VIF found with MAC fa:16:3e:2e:ba:0f, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:37:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-7e4a8d74-28a3-4fda-a13d-b99078f09e54 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.395s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:37:58 user nova-compute[75621]: INFO nova.compute.manager [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Detaching volume 12de2d0f-3dbb-446f-8c31-837990bcb8ea
Nov 27 23:37:58 user nova-compute[75621]: INFO nova.virt.block_device [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Attempting to driver detach volume 12de2d0f-3dbb-446f-8c31-837990bcb8ea from mountpoint /dev/vdb
Nov 27 23:37:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Attempting to detach device vdb from instance 5e1ed289-c656-4584-8507-efb7c21aff7d from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:37:58 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:37:58 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:37:58 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:37:58 user nova-compute[75621]:   <serial>12de2d0f-3dbb-446f-8c31-837990bcb8ea</serial>
Nov 27 23:37:58 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:37:58 user nova-compute[75621]: </disk>
Nov 27 23:37:58 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:37:58 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully detached device vdb from instance 5e1ed289-c656-4584-8507-efb7c21aff7d from the persistent domain config.
Nov 27 23:37:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e1ed289-c656-4584-8507-efb7c21aff7d from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:37:58 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:37:58 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:37:58 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:37:58 user nova-compute[75621]:   <serial>12de2d0f-3dbb-446f-8c31-837990bcb8ea</serial>
Nov 27 23:37:58 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:37:58 user nova-compute[75621]: </disk>
Nov 27 23:37:58 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:37:58 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:37:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:03 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:08 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:09 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:13 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:18 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e1ed289-c656-4584-8507-efb7c21aff7d is timed out.
Nov 27 23:38:18 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully detached device vdb from instance 5e1ed289-c656-4584-8507-efb7c21aff7d from the live domain config.
Nov 27 23:38:18 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lFyWLAYB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:38:18 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b66bb12-95df-4d91-94d2-1cc5a59627fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:38:18 user nova-compute[75621]: No targets found.
Nov 27 23:38:18 user nova-compute[75621]: iSNS:
Nov 27 23:38:18 user nova-compute[75621]: No targets found.
Nov 27 23:38:18 user nova-compute[75621]: STATIC:
Nov 27 23:38:18 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea
Nov 27 23:38:18 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:38:18 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:38:18 user nova-compute[75621]: FIRMWARE:
Nov 27 23:38:18 user nova-compute[75621]: No targets found.
Nov 27 23:38:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:38:18 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:38:18 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf37d3f-64b8-49e8-a625-39c6f96a9a9b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e25c10-7575-42d6-a764-b47e7155cd3d]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)
Nov 27 23:38:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea (non-flash)
Nov 27 23:38:18 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130048ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fe7d9c-22c3-4994-ab68-5547d4bdcdc6]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[110fe8fc-024f-4dd9-9da1-268bc00545f1]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2473c5f-8917-4dd5-b61c-a1d0b2533d91]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7623155-e12a-435d-bb9c-e987a1861bc6]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e751d6d4-c89f-444c-ae42-bc8cad0d8c15]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:38:18 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed145385-0573-4359-992d-58a615b2f10b]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260]
Nov 27 23:38:19 user nova-compute[75621]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea, portal: 172.16.0.220,3260] successful.
Nov 27 23:38:19 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:12de2d0f-3dbb-446f-8c31-837990bcb8ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[422351c0-04ae-4f96-b3b3-3dd7b6ef4ff8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] <== disconnect_volume: return (314ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG nova.objects.instance [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'flavor' on Instance uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-3061ab72-a0ab-4e43-98a9-044034f26d29 tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.629s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:20 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:38:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:21 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:21 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:38:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:38:23 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:38:23 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=24.8507080078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 5e1ed289-c656-4584-8507-efb7c21aff7d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:38:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:28 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:38:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:38:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:38:31 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:38:33 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:38 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG nova.compute.manager [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing instance network info cache due to event network-changed-b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] Acquiring lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] Acquired lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:38:48 user nova-compute[75621]: DEBUG nova.network.neutron [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Refreshing network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:49 user nova-compute[75621]: INFO nova.compute.manager [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Terminating instance
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-unplugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] No waiting events found dispatching network-vif-unplugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-2228d73e-e789-492b-82ba-3b8071372e0c req-95697e6f-4098-4cd0-ad6a-e14ed3c29a1d service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-unplugged-b07e18ee-cf49-4966-9ae1-8916e755df63 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.network.neutron [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updated VIF entry in instance network info cache for port b07e18ee-cf49-4966-9ae1-8916e755df63. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.network.neutron [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [{"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-e603c133-2320-48db-9a07-0c5142e9df13 req-ebe124b8-d744-4a9b-a851-9d8423422195 service nova] Releasing lock "refresh_cache-5e1ed289-c656-4584-8507-efb7c21aff7d" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:38:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Instance destroyed successfully.
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'resources' on Instance uuid 5e1ed289-c656-4584-8507-efb7c21aff7d {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1285787804',display_name='tempest-TestStampPattern-server-1285787804',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1285787804',id=52,image_ref='0a9932d4-2b73-43a8-bf4d-3a70227ae451',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:36:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-e9vzwfqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='da6d1f36-db42-45d7-b53a-bb7a9cde6841',image_min_disk='1',image_min_ram='0',image_owner_id='c69cbbae0c094d97be29dbdb118da717',image_owner_project_name='tempest-TestStampPattern-1043636858',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1043636858-project-member',image_user_id='aaa302e93e104c97affdb533f20057ff',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:36:02Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=5e1ed289-c656-4584-8507-efb7c21aff7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "b07e18ee-cf49-4966-9ae1-8916e755df63", "address": "fa:16:3e:2e:ba:0f", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb07e18ee-cf", "ovs_interfaceid": "b07e18ee-cf49-4966-9ae1-8916e755df63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG os_vif [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb07e18ee-cf, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b953ad22-68ac-47a9-98cc-680aaa71230f) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:38:49 user nova-compute[75621]: INFO os_vif [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:ba:0f,bridge_name='br-int',has_traffic_filtering=True,id=b07e18ee-cf49-4966-9ae1-8916e755df63,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb07e18ee-cf')
Nov 27 23:38:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Deleting instance files /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d_del
Nov 27 23:38:49 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Deletion of /opt/stack/data/nova/instances/5e1ed289-c656-4584-8507-efb7c21aff7d_del complete
Nov 27 23:38:49 user nova-compute[75621]: INFO nova.compute.manager [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 27 23:38:49 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:38:49 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:38:50 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:38:50 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Took 0.50 seconds to deallocate network for instance.
Nov 27 23:38:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:50 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:38:50 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:38:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.143s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:50 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Deleted allocations for instance 5e1ed289-c656-4584-8507-efb7c21aff7d
Nov 27 23:38:50 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a28ac3-4ee5-4fc0-9ae5-19e43b411c4b tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.708s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:38:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] Acquiring lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:38:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:38:51 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] Lock "5e1ed289-c656-4584-8507-efb7c21aff7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:38:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] No waiting events found dispatching network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:38:51 user nova-compute[75621]: WARNING nova.compute.manager [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received unexpected event network-vif-plugged-b07e18ee-cf49-4966-9ae1-8916e755df63 for instance with vm_state deleted and task_state None.
Nov 27 23:38:51 user nova-compute[75621]: DEBUG nova.compute.manager [req-8460f092-b39d-4f92-bf56-568fa8c2c536 req-337cff56-17d3-408d-9284-4359d9b6b0f5 service nova] [instance: 5e1ed289-c656-4584-8507-efb7c21aff7d] Received event network-vif-deleted-b07e18ee-cf49-4966-9ae1-8916e755df63 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:38:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:38:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:10 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:21 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:39:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:23 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:23 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:39:24 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:39:24 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:39:24 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9056MB free_disk=24.851314544677734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance da6d1f36-db42-45d7-b53a-bb7a9cde6841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:39:24 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:39:25 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:39:25 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:39:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:29 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:32 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:39:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:36 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:39:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG nova.compute.manager [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing instance network info cache due to event network-changed-5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] Acquiring lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] Acquired lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG nova.network.neutron [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Refreshing network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:46 user nova-compute[75621]: INFO nova.compute.manager [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Terminating instance
Nov 27 23:39:46 user nova-compute[75621]: DEBUG nova.compute.manager [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:39:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-unplugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] No waiting events found dispatching network-vif-unplugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.compute.manager [req-daf7489f-864c-43e7-9391-acbbaf1f9be0 req-dd84cb46-5541-47f5-89c9-fd15dc8ce336 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-unplugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updated VIF entry in instance network info cache for port 5f3c1226-c248-4794-9fbd-d5852b11b1e3. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.network.neutron [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [{"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dbef9638-5011-4ec9-bc48-9e28bd65d74d req-0fb7fcfb-04ad-406f-934a-d71cc6740ca2 service nova] Releasing lock "refresh_cache-da6d1f36-db42-45d7-b53a-bb7a9cde6841" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:39:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Instance destroyed successfully.
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lazy-loading 'resources' on Instance uuid da6d1f36-db42-45d7-b53a-bb7a9cde6841 {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:32:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1198914346',display_name='tempest-TestStampPattern-server-1198914346',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1198914346',id=51,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFzut8BGaoAtUaThJd44Aqyq7v9FTurfmgXnLZFPzeR9AsCRDUfWd3WNTF/CuKm3WiDT/4kv2Snx1M40EpsZPuMUdkFuE5WKyoY3I73aakAV+IpbYjnM6yu1Kq9zmWa6fA==',key_name='tempest-TestStampPattern-1967465630',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:32:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c69cbbae0c094d97be29dbdb118da717',ramdisk_id='',reservation_id='r-luocg7pz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1043636858',owner_user_name='tempest-TestStampPattern-1043636858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:35:53Z,user_data=None,user_id='aaa302e93e104c97affdb533f20057ff',uuid=da6d1f36-db42-45d7-b53a-bb7a9cde6841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converting VIF {"id": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "address": "fa:16:3e:94:d8:e9", "network": {"id": "927c950f-271a-4af7-aba5-84ce3433998d", "bridge": "br-int", "label": "tempest-TestStampPattern-434505359-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c69cbbae0c094d97be29dbdb118da717", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f3c1226-c2", "ovs_interfaceid": "5f3c1226-c248-4794-9fbd-d5852b11b1e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG os_vif [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f3c1226-c2, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20eee11a-3857-4f5f-a97e-ac1108c409c1) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:47 user nova-compute[75621]: INFO os_vif [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:d8:e9,bridge_name='br-int',has_traffic_filtering=True,id=5f3c1226-c248-4794-9fbd-d5852b11b1e3,network=Network(927c950f-271a-4af7-aba5-84ce3433998d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f3c1226-c2')
Nov 27 23:39:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Deleting instance files /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841_del
Nov 27 23:39:47 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Deletion of /opt/stack/data/nova/instances/da6d1f36-db42-45d7-b53a-bb7a9cde6841_del complete
Nov 27 23:39:47 user nova-compute[75621]: INFO nova.compute.manager [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 27 23:39:47 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:39:47 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:39:48 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:39:48 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Took 0.79 seconds to deallocate network for instance.
Nov 27 23:39:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:48 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:39:48 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:39:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:48 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Deleted allocations for instance da6d1f36-db42-45d7-b53a-bb7a9cde6841
Nov 27 23:39:48 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d6a2bd78-fe1d-41d7-91f3-edb1dd558aed tempest-TestStampPattern-1043636858 tempest-TestStampPattern-1043636858-project-member] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.939s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:39:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] Acquiring lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:39:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:39:49 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] Lock "da6d1f36-db42-45d7-b53a-bb7a9cde6841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:39:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] No waiting events found dispatching network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:39:49 user nova-compute[75621]: WARNING nova.compute.manager [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received unexpected event network-vif-plugged-5f3c1226-c248-4794-9fbd-d5852b11b1e3 for instance with vm_state deleted and task_state None.
Nov 27 23:39:49 user nova-compute[75621]: DEBUG nova.compute.manager [req-dd758d14-4435-4e79-9e70-cb9c28879b97 req-fddc5d31-1403-45b0-83de-a0d0d9c75807 service nova] [instance: da6d1f36-db42-45d7-b53a-bb7a9cde6841] Received event network-vif-deleted-5f3c1226-c248-4794-9fbd-d5852b11b1e3 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:39:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:39:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:11 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:15 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:40:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:40:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:40:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:40:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:40:24 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:40:24 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:40:25 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:40:25 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=24.97601318359375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:40:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:40:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:29 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:33 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:40:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:40:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:40:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:40:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:40:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:43 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:46 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:40:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:40:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:12 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:17 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:22 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:41:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:41:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:41:26 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:41:26 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9238MB free_disk=24.96611785888672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:41:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.109s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:41:27 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:31 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:32 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:33 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:41:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:41:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:41:37 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:41:42 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:41:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:51 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:52 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:53 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:57 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:41:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:01 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:02 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Starting instance... {{(pid=75621) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75621) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 27 23:42:07 user nova-compute[75621]: INFO nova.compute.claims [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Claim successful on node user
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Start building networks asynchronously for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Allocating IP information in the background. {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] allocate_for_instance() {{(pid=75621) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 27 23:42:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Start building block device mappings for instance. {{(pid=75621) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.policy [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a10a98ac365349b5bf027d55faccb5ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb400e97b698466f9695fe9555ca52bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75621) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Start spawning the instance on the hypervisor. {{(pid=75621) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Creating instance directory {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 27 23:42:07 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Creating image(s)
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "/opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "/opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "/opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:07 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.216s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.218s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk 1073741824 {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f,backing_fmt=raw /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk 1073741824" returned: 0 in 0.062s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "72452afa9e65d6107cc4dd78b04d41f559b68b9f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/72452afa9e65d6107cc4dd78b04d41f559b68b9f --force-share --output=json" returned: 0 in 0.192s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Checking if we can resize image /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk. size=1073741824 {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Successfully created port: 3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG nova.virt.disk.api [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Cannot resize image /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk to a smaller size. {{(pid=75621) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Created local disks {{(pid=75621) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Ensure instance console log exists: /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/console.log {{(pid=75621) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:08 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Successfully updated port: 3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Building network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-changed-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.compute.manager [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Refreshing instance network info cache due to event network-changed-3f206712-f261-4d9b-8b65-52a482d08fa6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Instance cache missing network info. {{(pid=75621) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.neutron [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Instance network_info: |[{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75621) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Refreshing network info cache for port 3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Start _get_guest_xml network_info=[{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'boot_index': 0, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'image_id': '6631148d-0ff5-48f2-bd92-4bf6df1a42c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 27 23:42:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:42:09 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CPU controller missing on host. {{(pid=75621) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.host [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CPU controller found on host. {{(pid=75621) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75621) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-27T22:56:55Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-27T22:57:06Z,direct_url=<?>,disk_format='qcow2',id=6631148d-0ff5-48f2-bd92-4bf6df1a42c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c56d2cf12ea4cb7b55bba91a5f6a5a6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-27T22:57:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flavor limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Image limits 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flavor pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Image pref 0:0:0 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75621) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Got 1 possible topologies {{(pid=75621) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.hardware [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75621) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465678408',display_name='tempest-SnapshotDataIntegrityTests-server-1465678408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465678408',id=53,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJljPfJ4wJ9esca0wkBK22HNlAnIrQGy5LL3cOI2dZEsBGsLflqXuPhqRDckOVj5qh0SuRlvSV7NZ5MagPzqG9E/zmJuQwkplZjwG3T2QX+4biNDpOPpC+ten97f9JHHBg==',key_name='tempest-keypair-1476131376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb400e97b698466f9695fe9555ca52bb',ramdisk_id='',reservation_id='r-j4ayvii0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1108010224',owner_user_name='tempest-SnapshotDataIntegrityTests-1108010224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a10a98ac365349b5bf027d55faccb5ac',uuid=27c704b5-254e-454a-a8b4-c003a6f59b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75621) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converting VIF {"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:42:09 user nova-compute[75621]: DEBUG nova.objects.instance [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'pci_devices' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] End _get_guest_xml xml=<domain type="kvm">
Nov 27 23:42:10 user nova-compute[75621]:   <uuid>27c704b5-254e-454a-a8b4-c003a6f59b6b</uuid>
Nov 27 23:42:10 user nova-compute[75621]:   <name>instance-00000035</name>
Nov 27 23:42:10 user nova-compute[75621]:   <memory>524288</memory>
Nov 27 23:42:10 user nova-compute[75621]:   <vcpu>1</vcpu>
Nov 27 23:42:10 user nova-compute[75621]:   <metadata>
Nov 27 23:42:10 user nova-compute[75621]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 27 23:42:10 user nova-compute[75621]:       <nova:package version="0.0.0"/>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1465678408</nova:name>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:creationTime>2023-11-27 23:42:09</nova:creationTime>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:flavor name="m1.tiny">
Nov 27 23:42:10 user nova-compute[75621]:         <nova:memory>512</nova:memory>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:disk>1</nova:disk>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:swap>0</nova:swap>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:ephemeral>0</nova:ephemeral>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:vcpus>1</nova:vcpus>
Nov 27 23:42:10 user nova-compute[75621]:       </nova:flavor>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:owner>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:user uuid="a10a98ac365349b5bf027d55faccb5ac">tempest-SnapshotDataIntegrityTests-1108010224-project-member</nova:user>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:project uuid="bb400e97b698466f9695fe9555ca52bb">tempest-SnapshotDataIntegrityTests-1108010224</nova:project>
Nov 27 23:42:10 user nova-compute[75621]:       </nova:owner>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:root type="image" uuid="6631148d-0ff5-48f2-bd92-4bf6df1a42c4"/>
Nov 27 23:42:10 user nova-compute[75621]:       <nova:ports>
Nov 27 23:42:10 user nova-compute[75621]:         <nova:port uuid="3f206712-f261-4d9b-8b65-52a482d08fa6">
Nov 27 23:42:10 user nova-compute[75621]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 27 23:42:10 user nova-compute[75621]:         </nova:port>
Nov 27 23:42:10 user nova-compute[75621]:       </nova:ports>
Nov 27 23:42:10 user nova-compute[75621]:     </nova:instance>
Nov 27 23:42:10 user nova-compute[75621]:   </metadata>
Nov 27 23:42:10 user nova-compute[75621]:   <sysinfo type="smbios">
Nov 27 23:42:10 user nova-compute[75621]:     <system>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="product">OpenStack Nova</entry>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="version">0.0.0</entry>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="serial">27c704b5-254e-454a-a8b4-c003a6f59b6b</entry>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="uuid">27c704b5-254e-454a-a8b4-c003a6f59b6b</entry>
Nov 27 23:42:10 user nova-compute[75621]:       <entry name="family">Virtual Machine</entry>
Nov 27 23:42:10 user nova-compute[75621]:     </system>
Nov 27 23:42:10 user nova-compute[75621]:   </sysinfo>
Nov 27 23:42:10 user nova-compute[75621]:   <os>
Nov 27 23:42:10 user nova-compute[75621]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 27 23:42:10 user nova-compute[75621]:     <boot dev="hd"/>
Nov 27 23:42:10 user nova-compute[75621]:     <smbios mode="sysinfo"/>
Nov 27 23:42:10 user nova-compute[75621]:   </os>
Nov 27 23:42:10 user nova-compute[75621]:   <features>
Nov 27 23:42:10 user nova-compute[75621]:     <acpi/>
Nov 27 23:42:10 user nova-compute[75621]:     <apic/>
Nov 27 23:42:10 user nova-compute[75621]:     <vmcoreinfo/>
Nov 27 23:42:10 user nova-compute[75621]:   </features>
Nov 27 23:42:10 user nova-compute[75621]:   <clock offset="utc">
Nov 27 23:42:10 user nova-compute[75621]:     <timer name="pit" tickpolicy="delay"/>
Nov 27 23:42:10 user nova-compute[75621]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 27 23:42:10 user nova-compute[75621]:     <timer name="hpet" present="no"/>
Nov 27 23:42:10 user nova-compute[75621]:   </clock>
Nov 27 23:42:10 user nova-compute[75621]:   <cpu mode="custom" match="exact">
Nov 27 23:42:10 user nova-compute[75621]:     <model>Nehalem</model>
Nov 27 23:42:10 user nova-compute[75621]:     <topology sockets="1" cores="1" threads="1"/>
Nov 27 23:42:10 user nova-compute[75621]:   </cpu>
Nov 27 23:42:10 user nova-compute[75621]:   <devices>
Nov 27 23:42:10 user nova-compute[75621]:     <disk type="file" device="disk">
Nov 27 23:42:10 user nova-compute[75621]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 27 23:42:10 user nova-compute[75621]:       <source file="/opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk"/>
Nov 27 23:42:10 user nova-compute[75621]:       <target dev="vda" bus="virtio"/>
Nov 27 23:42:10 user nova-compute[75621]:     </disk>
Nov 27 23:42:10 user nova-compute[75621]:     <interface type="ethernet">
Nov 27 23:42:10 user nova-compute[75621]:       <mac address="fa:16:3e:01:e2:1b"/>
Nov 27 23:42:10 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:42:10 user nova-compute[75621]:       <mtu size="1442"/>
Nov 27 23:42:10 user nova-compute[75621]:       <target dev="tap3f206712-f2"/>
Nov 27 23:42:10 user nova-compute[75621]:     </interface>
Nov 27 23:42:10 user nova-compute[75621]:     <serial type="pty">
Nov 27 23:42:10 user nova-compute[75621]:       <log file="/opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/console.log" append="off"/>
Nov 27 23:42:10 user nova-compute[75621]:     </serial>
Nov 27 23:42:10 user nova-compute[75621]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 27 23:42:10 user nova-compute[75621]:     <video>
Nov 27 23:42:10 user nova-compute[75621]:       <model type="virtio"/>
Nov 27 23:42:10 user nova-compute[75621]:     </video>
Nov 27 23:42:10 user nova-compute[75621]:     <rng model="virtio">
Nov 27 23:42:10 user nova-compute[75621]:       <backend model="random">/dev/urandom</backend>
Nov 27 23:42:10 user nova-compute[75621]:     </rng>
Nov 27 23:42:10 user nova-compute[75621]:     <controller type="usb" index="0" model="none"/>
Nov 27 23:42:10 user nova-compute[75621]:     <memballoon model="virtio">
Nov 27 23:42:10 user nova-compute[75621]:       <stats period="10"/>
Nov 27 23:42:10 user nova-compute[75621]:     </memballoon>
Nov 27 23:42:10 user nova-compute[75621]:   </devices>
Nov 27 23:42:10 user nova-compute[75621]: </domain>
Nov 27 23:42:10 user nova-compute[75621]:  {{(pid=75621) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465678408',display_name='tempest-SnapshotDataIntegrityTests-server-1465678408',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465678408',id=53,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJljPfJ4wJ9esca0wkBK22HNlAnIrQGy5LL3cOI2dZEsBGsLflqXuPhqRDckOVj5qh0SuRlvSV7NZ5MagPzqG9E/zmJuQwkplZjwG3T2QX+4biNDpOPpC+ten97f9JHHBg==',key_name='tempest-keypair-1476131376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb400e97b698466f9695fe9555ca52bb',ramdisk_id='',reservation_id='r-j4ayvii0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1108010224',owner_user_name='tempest-SnapshotDataIntegrityTests-1108010224-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-27T23:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a10a98ac365349b5bf027d55faccb5ac',uuid=27c704b5-254e-454a-a8b4-c003a6f59b6b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converting VIF {"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG os_vif [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2') {{(pid=75621) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '651120cb-8eec-586f-8b88-0f2ae4090cfb', '_type': 'linux-noop'}}, row=False) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f206712-f2, may_exist=True, interface_attrs={}) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f206712-f2, col_values=(('qos', UUID('2d97f745-fdaa-43f8-84f0-f0bd24c17776')),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f206712-f2, col_values=(('external_ids', {'iface-id': '3f206712-f261-4d9b-8b65-52a482d08fa6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:e2:1b', 'vm-uuid': '27c704b5-254e-454a-a8b4-c003a6f59b6b'}),), if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:10 user nova-compute[75621]: INFO os_vif [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2')
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No VIF found with MAC fa:16:3e:01:e2:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated VIF entry in instance network info cache for port 3f206712-f261-4d9b-8b65-52a482d08fa6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG nova.network.neutron [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:42:10 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-2b9cf974-ae8c-494f-be19-c98979fae515 req-284c6980-933c-4132-b651-db750455f83d service nova] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:11 user nova-compute[75621]: DEBUG nova.compute.manager [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] No waiting events found dispatching network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:42:11 user nova-compute[75621]: WARNING nova.compute.manager [req-d5d9244f-aa34-4044-8019-ceba2da15063 req-d836dbef-57f9-40c1-bf79-4e618b7c676d service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received unexpected event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 for instance with vm_state building and task_state spawning.
Nov 27 23:42:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:12 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Instance event wait completed in 0 seconds for  {{(pid=75621) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Guest created on hypervisor {{(pid=75621) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 27 23:42:13 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Instance spawned successfully.
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.compute.manager [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] No waiting events found dispatching network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:42:13 user nova-compute[75621]: WARNING nova.compute.manager [req-1525b7df-8aa9-4ddb-aaae-23426a26d96b req-bdce68fa-d5f6-4cb0-b718-e51d3f008d1c service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received unexpected event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 for instance with vm_state building and task_state spawning.
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_cdrom_bus of ide {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_disk_bus of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_input_bus of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_pointer_model of None {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_video_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:13 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Found default for hw_vif_model of virtio {{(pid=75621) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 27 23:42:14 user nova-compute[75621]: INFO nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 27 23:42:14 user nova-compute[75621]: DEBUG nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Checking state {{(pid=75621) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 27 23:42:14 user nova-compute[75621]: INFO nova.compute.manager [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Took 6.86 seconds to build instance.
Nov 27 23:42:14 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-77eacbcd-aaa7-448e-8b7d-e378b7bda6d6 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.985s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:23 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:42:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:42:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:42:27 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:42:27 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=24.950286865234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:42:27 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:42:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:42:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.878s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:42:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:42:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:42:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:35 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:35 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:42:35 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:42:36 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:42:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:45 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:42:45 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:42:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:42:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:42:58 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:18 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:43:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:43:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:43:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:43:27 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:43:28 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:43:28 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=24.920825958251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:43:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:43:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:31 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:43:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:43:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:43:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:43:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-changed-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG nova.compute.manager [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Refreshing instance network info cache due to event network-changed-3f206712-f261-4d9b-8b65-52a482d08fa6. {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Refreshing network info cache for port 3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated VIF entry in instance network info cache for port 3f206712-f261-4d9b-8b65-52a482d08fa6. {{(pid=75621) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG nova.network.neutron [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:43:58 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-987033f3-e363-4b55-9a9c-5664a04ec946 req-77398b52-e7b0-4737-8689-d6a631e432c2 service nova] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:43:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:44:02 user nova-compute[75621]: INFO nova.compute.manager [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attaching volume 58bee8d4-325a-4718-b3f6-3eafd79b5111 to /dev/vdb
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.utils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a27682-91e5-4f31-b2f5-874445116364]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1b6c08-2eb4-4541-9349-261c9a0ab7d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92792e4-6ece-451e-b150-09809ac3631a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0c82b-4800-4a93-9137-78605629cf8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:44:02 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:44:02 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[383bbe15-b65e-4e09-b879-833b83ad874c]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG os_brick.utils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:44:02 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating existing volume attachment record: 2e625d87-8233-4b73-bb2b-f3a07632a357 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:44:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBrJmjgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:44:09 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:44:09 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:44:09 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87c416c-a47a-4493-a2ab-6aac46c6b065]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:44:09 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[212129c6-cdb4-4be7-ab3a-fd70799b33c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111] added
Nov 27 23:44:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc2b33-7f9a-4aeb-986e-80696b04be68]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e69942-1224-4680-8d17-a32a755d5df8]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OBrJmjgx {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OBrJmjgx" returned: 0 in 0.033s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[33abcf6b-01e3-479d-a40f-40ff712e9994]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OBrJmjgx'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6f794-264d-440b-9966-abc3c429dee7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbabeb3f-71e2-42e1-be41-2650f0b32da8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:44:09 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:44:09 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:44:09 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:44:09 user nova-compute[75621]: 
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b1e2c-28b0-403a-96a3-77ed1279a611]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260]
Nov 27 23:44:09 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260] successful.
Nov 27 23:44:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515971f-a64d-4fe9-9380-4144381edaa9]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2894ed0f-c04a-4642-90f9-6517b9360a93]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)
Nov 27 23:44:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)
Nov 27 23:44:09 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a363c3-afad-48f6-85b4-921bd1435876]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBrJmjgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:44:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26566326266663662', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566326266663662', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.objects.instance [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:44:10 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:44:10 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:44:10 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:44:10 user nova-compute[75621]:   <serial>58bee8d4-325a-4718-b3f6-3eafd79b5111</serial>
Nov 27 23:44:10 user nova-compute[75621]: </disk>
Nov 27 23:44:10 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:44:10 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No VIF found with MAC fa:16:3e:01:e2:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:44:11 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-d564058b-cdd0-4f7e-8100-7d76e3b35994 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.695s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:44:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:14 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:44:25 user nova-compute[75621]: INFO nova.compute.manager [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Detaching volume 58bee8d4-325a-4718-b3f6-3eafd79b5111
Nov 27 23:44:25 user nova-compute[75621]: INFO nova.virt.block_device [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attempting to driver detach volume 58bee8d4-325a-4718-b3f6-3eafd79b5111 from mountpoint /dev/vdb
Nov 27 23:44:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Attempting to detach device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:44:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:44:25 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:44:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:44:25 user nova-compute[75621]:   <serial>58bee8d4-325a-4718-b3f6-3eafd79b5111</serial>
Nov 27 23:44:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:44:25 user nova-compute[75621]: </disk>
Nov 27 23:44:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:44:25 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config.
Nov 27 23:44:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:44:25 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:44:25 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:44:25 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:44:25 user nova-compute[75621]:   <serial>58bee8d4-325a-4718-b3f6-3eafd79b5111</serial>
Nov 27 23:44:25 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:44:25 user nova-compute[75621]: </disk>
Nov 27 23:44:25 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:25 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:44:26 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:44:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:44:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:44:28 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:44:28 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:29 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:44:29 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9037MB free_disk=24.919532775878906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:44:29 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:44:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:33 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:44:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:44:37 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:44:38 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:44:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:44:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:46 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b is timed out.
Nov 27 23:44:46 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config.
Nov 27 23:44:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OBrJmjgx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:44:46 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0623fb05-cb4a-4292-b07c-8a7c2e53b136]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:44:46 user nova-compute[75621]: No targets found.
Nov 27 23:44:46 user nova-compute[75621]: iSNS:
Nov 27 23:44:46 user nova-compute[75621]: No targets found.
Nov 27 23:44:46 user nova-compute[75621]: STATIC:
Nov 27 23:44:46 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111
Nov 27 23:44:46 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:44:46 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:44:46 user nova-compute[75621]: FIRMWARE:
Nov 27 23:44:46 user nova-compute[75621]: No targets found.
Nov 27 23:44:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:44:46 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:44:46 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a88d8c8-9bf4-4569-973d-1bf76f96de33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce23f8f-6988-4c30-9a79-7f2f2f4c4c90]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)
Nov 27 23:44:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 (non-flash)
Nov 27 23:44:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e05e3520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f546f406-9d4a-4d8a-8492-f473b877d9c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[691ea6da-eca5-4d8f-8972-fa95a5f5569f]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc39250-407f-40a3-a6fd-c43e94f36290]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[82053e1c-507c-47a0-becf-bce317c3f0b5]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6c2646-8273-4b86-8d8b-37475ef65054]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0d95d-da56-4930-90c7-61015c592d1d]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260]
Nov 27 23:44:46 user nova-compute[75621]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111, portal: 172.16.0.220,3260] successful.
Nov 27 23:44:46 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58bee8d4-325a-4718-b3f6-3eafd79b5111 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a9f0a-ec72-4260-b5ef-f1d9474c4d1b]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== disconnect_volume: return (303ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:44:46 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:44:47 user nova-compute[75621]: DEBUG nova.objects.instance [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:44:47 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-bfbe653c-4f65-4a25-93a6-cb36c59e5c12 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.627s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:44:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:16 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:45:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:45:18 user nova-compute[75621]: DEBUG nova.objects.instance [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:45:18 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:45:19 user nova-compute[75621]: INFO nova.compute.manager [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attaching volume f8123df0-d7ca-4b8b-8d94-a3bec6f0168c to /dev/vdb
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.utils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a420de6e-c59a-404f-b614-664d01779c9f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc05a578-e5d6-4c8c-acb8-7eca5226ca6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[470e7ea1-190d-4363-8c79-b5034b5706da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[241db34a-2751-439f-9996-4c6729685d61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:45:19 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:45:19 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99812f-9946-4c65-88e7-539b44da421d]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG os_brick.utils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating existing volume attachment record: 3b73ac5e-92be-43f8-b3f3-09fae0b899d4 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:45:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htumVKJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:45:25 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:45:25 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:45:25 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce055956-8e2d-40f7-a43d-9bbe74437152]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:45:25 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cba41d-582a-4ca6-bd03-2f63be89ed9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c] added
Nov 27 23:45:25 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e47d7fb-0585-41c4-aad6-77479f4bb1ce]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d0fb1-d303-414c-872c-689888471d22]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htumVKJW {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v htumVKJW" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7996c1d1-18a3-44fa-bfdd-cf669c62f8e7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'htumVKJW'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c567d254-6492-4e75-a2ca-be0c3c020b1f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a44e50-ebec-441f-97c0-a78e652ca05d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:45:25 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:45:25 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:45:25 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:45:25 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:45:25 user nova-compute[75621]: 
Nov 27 23:45:25 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6be18-eec7-4fd7-9d98-8fff88407e4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260]
Nov 27 23:45:26 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260] successful.
Nov 27 23:45:26 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98115e0-385e-4523-8545-c80a29f36205]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[618f1eef-f2e0-41ad-9191-7b9646538743]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)
Nov 27 23:45:26 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)
Nov 27 23:45:26 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e0a22f-c768-47c1-8d65-5a036d9ea1b3]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:26 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htumVKJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26530643931353734', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530643931353734', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.objects.instance [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:45:27 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:45:27 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:45:27 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:45:27 user nova-compute[75621]:   <serial>f8123df0-d7ca-4b8b-8d94-a3bec6f0168c</serial>
Nov 27 23:45:27 user nova-compute[75621]: </disk>
Nov 27 23:45:27 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No VIF found with MAC fa:16:3e:01:e2:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:45:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-60fb5433-36dc-43ae-aa8d-6227e8ea6ebf tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.577s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:45:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:45:30 user nova-compute[75621]: INFO nova.compute.manager [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Detaching volume f8123df0-d7ca-4b8b-8d94-a3bec6f0168c
Nov 27 23:45:30 user nova-compute[75621]: INFO nova.virt.block_device [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attempting to driver detach volume f8123df0-d7ca-4b8b-8d94-a3bec6f0168c from mountpoint /dev/vdb
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Attempting to detach device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:45:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:45:30 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:45:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:45:30 user nova-compute[75621]:   <serial>f8123df0-d7ca-4b8b-8d94-a3bec6f0168c</serial>
Nov 27 23:45:30 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:45:30 user nova-compute[75621]: </disk>
Nov 27 23:45:30 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:45:30 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config.
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:45:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:45:30 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:45:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:45:30 user nova-compute[75621]:   <serial>f8123df0-d7ca-4b8b-8d94-a3bec6f0168c</serial>
Nov 27 23:45:30 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:45:30 user nova-compute[75621]: </disk>
Nov 27 23:45:30 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:45:30 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:31 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:45:31 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.918556213378906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:45:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:45:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:35 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:45:39 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:45:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:49 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:50 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b is timed out.
Nov 27 23:45:50 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config.
Nov 27 23:45:50 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'htumVKJW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:45:50 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee70e87-d8d3-4d84-a7c8-abdb0cd3cd05]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:45:50 user nova-compute[75621]: No targets found.
Nov 27 23:45:50 user nova-compute[75621]: iSNS:
Nov 27 23:45:50 user nova-compute[75621]: No targets found.
Nov 27 23:45:50 user nova-compute[75621]: STATIC:
Nov 27 23:45:50 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c
Nov 27 23:45:50 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:45:50 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:45:50 user nova-compute[75621]: FIRMWARE:
Nov 27 23:45:50 user nova-compute[75621]: No targets found.
Nov 27 23:45:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:45:50 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:45:50 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bd2755-cd4f-43f4-a135-b727be288f77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b6ad7c-0ded-4225-be8a-8b4617167e16]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)
Nov 27 23:45:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c (non-flash)
Nov 27 23:45:50 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f13000f56c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:45:50 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9403144-bb4c-4009-9d57-90f324b1f868]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5306cf-1f9e-4c86-84f3-068cdc9777db]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0dd37-548e-4d42-b1c8-09b3d40f4da7]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[8419a33f-ab30-4461-bf7a-395f8bc4ebce]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7083037-a9e2-46b6-9446-57b59ad80950]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1291efb-8c1b-485c-9b1e-c066941237e7]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260]
Nov 27 23:45:51 user nova-compute[75621]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c, portal: 172.16.0.220,3260] successful.
Nov 27 23:45:51 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8123df0-d7ca-4b8b-8d94-a3bec6f0168c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45bdc9a-9baf-4874-bc2f-df880959c6b6]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== disconnect_volume: return (281ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:45:51 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:45:52 user nova-compute[75621]: DEBUG nova.objects.instance [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:45:52 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-5b76da1a-dc28-4be0-b47f-4f2d2f49b421 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:45:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:17 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG nova.objects.instance [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:46:22 user nova-compute[75621]: INFO nova.compute.manager [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attaching volume 3e3511a3-69ed-4719-ad2d-0d4950390020 to /dev/vdb
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.utils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[613cffd0-5b89-4997-81a6-d2e4b56b6e59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd8386a-537e-408f-84d9-ca26036478d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a21a2e5-891e-470f-a188-e46dfaa9d42b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9903892-261e-4158-919a-c1ffa6565dd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:46:22 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cf3b53-9b01-4c75-8003-a520d9f764da]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG os_brick.utils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating existing volume attachment record: 8d8410cb-48a2-4c40-856d-c3d12a41d076 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:27 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLWeDcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:46:29 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:46:29 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:46:29 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e5c8b1-db6a-4c34-a121-84e397ec00ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:46:29 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb6ad5-3909-481b-9c77-72bcb6480b1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020] added
Nov 27 23:46:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[92327672-306c-4663-945e-debb78bdface]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac20eb1-544a-4c07-8ba5-d7244ab3c100]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLWeDcSp {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BLWeDcSp" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a2633-67a1-445f-9a82-de341132a60a]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BLWeDcSp'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77e2d90-f488-47b4-a57e-73095d30b6cd]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7d8b60-e628-4cc4-aad6-443dfc8abbe6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:46:29 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:46:29 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:46:29 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:46:29 user nova-compute[75621]: 
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[047330f4-8d2b-47b0-a47c-4a2c256a40da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260]
Nov 27 23:46:29 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260] successful.
Nov 27 23:46:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d180a07-222d-44b3-abe2-9f1105013371]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2215250-fa73-428c-b25a-f1a623024830]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)
Nov 27 23:46:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)
Nov 27 23:46:29 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af41c88-adaf-4c9f-9f0e-f7cfaece9105]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:46:29 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLWeDcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23337333932626137', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337333932626137', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG nova.objects.instance [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:46:30 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:46:30 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:46:30 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:46:30 user nova-compute[75621]:   <serial>3e3511a3-69ed-4719-ad2d-0d4950390020</serial>
Nov 27 23:46:30 user nova-compute[75621]: </disk>
Nov 27 23:46:30 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:46:30 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No VIF found with MAC fa:16:3e:01:e2:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-781876a2-084e-46ca-a0c0-5d9c78f99d92 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.653s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75621) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11213}}
Nov 27 23:46:31 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:46:31 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9023MB free_disk=24.917709350585938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:46:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:46:32 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:46:32 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:46:32 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:46:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:46:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:46:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:46:33 user nova-compute[75621]: INFO nova.compute.manager [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Detaching volume 3e3511a3-69ed-4719-ad2d-0d4950390020
Nov 27 23:46:34 user nova-compute[75621]: INFO nova.virt.block_device [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attempting to driver detach volume 3e3511a3-69ed-4719-ad2d-0d4950390020 from mountpoint /dev/vdb
Nov 27 23:46:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Attempting to detach device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:46:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:46:34 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:46:34 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:46:34 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:46:34 user nova-compute[75621]:   <serial>3e3511a3-69ed-4719-ad2d-0d4950390020</serial>
Nov 27 23:46:34 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:46:34 user nova-compute[75621]: </disk>
Nov 27 23:46:34 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:46:34 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config.
Nov 27 23:46:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:46:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:46:34 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:46:34 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:46:34 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:46:34 user nova-compute[75621]:   <serial>3e3511a3-69ed-4719-ad2d-0d4950390020</serial>
Nov 27 23:46:34 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:46:34 user nova-compute[75621]: </disk>
Nov 27 23:46:34 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:46:34 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:46:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:36 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:46:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:46:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:46:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:54 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b is timed out.
Nov 27 23:46:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config.
Nov 27 23:46:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BLWeDcSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:46:54 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd11d224-b50b-475c-b796-8d53245ea061]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:46:54 user nova-compute[75621]: No targets found.
Nov 27 23:46:54 user nova-compute[75621]: iSNS:
Nov 27 23:46:54 user nova-compute[75621]: No targets found.
Nov 27 23:46:54 user nova-compute[75621]: STATIC:
Nov 27 23:46:54 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020
Nov 27 23:46:54 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:46:54 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:46:54 user nova-compute[75621]: FIRMWARE:
Nov 27 23:46:54 user nova-compute[75621]: No targets found.
Nov 27 23:46:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:46:54 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:46:54 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[12962abe-250b-4285-b381-1d9efbc1adb2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a12f4f2-21b1-421a-84cf-bbb129b96475]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)
Nov 27 23:46:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 (non-flash)
Nov 27 23:46:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f12e0799360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa987069-04e2-482f-a836-9cef0fe52230]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d508e0-adfd-4a8a-a5b5-ef9d6194d564]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67f88cb-22a1-4304-9165-2407738a4505]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1398d386-1ac6-40a5-a9f8-2d439bc7767b]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ce5175-0bb5-4f28-ab3e-95ef4392855c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e924ba-b73a-4b09-b28a-873e03203d77]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260]
Nov 27 23:46:54 user nova-compute[75621]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020, portal: 172.16.0.220,3260] successful.
Nov 27 23:46:54 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3511a3-69ed-4719-ad2d-0d4950390020 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[201fcaea-efea-4a87-91ae-c90a6b7be3be]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== disconnect_volume: return (301ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:46:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG nova.objects.instance [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:46:55 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-33ab2970-b07a-4c25-9f9f-c4e56df3be63 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.638s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:23 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:47:27 user nova-compute[75621]: INFO nova.compute.manager [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attaching volume ef3198ff-7761-465c-b31c-45cd66877799 to /dev/vdb
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.utils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca833fd-e8fa-47c2-b6ca-95a0ad738ee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6ff4b8326ec\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[3561718d-cc91-4249-ba4c-849cd2c821d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300ee2e-5e54-4e83-b015-c4a5844d3ad6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cde254-f8d5-4353-805b-993ddeb20aa8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Running cmd (subprocess): nvme version {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] 'nvme version' failed. Not Retrying. {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] nvme not present on system {{(pid=75621) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 27 23:47:27 user nova-compute[75621]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 27 23:47:27 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7024f0b-61dd-48e3-a9d9-fc5e5f375c25]: (4, '') {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75621) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.lightos [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] LIGHTOS: no hostnqn found. {{(pid=75621) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG os_brick.utils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6ff4b8326ec', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:47:27 user nova-compute[75621]: DEBUG nova.virt.block_device [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating existing volume attachment record: 74f4aa19-1955-40b0-b78d-b07457bab795 {{(pid=75621) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 27 23:47:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:28 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:47:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:31 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:47:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:47:31 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:47:31 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:47:32 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:47:32 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=24.91678237915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:47:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing inventories for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating ProviderTree inventory for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Updating inventory in ProviderTree for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing aggregate associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, aggregates: None {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Refreshing trait associations for resource provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f, traits: COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE2,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_PCNET {{(pid=75621) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:47:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:47:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Calling os-brick to attach iSCSI Volume {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwaYVtZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:47:36 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:47:36 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:47:36 user nova-compute[75621]: INFO os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e157df2-6278-42b1-9b02-1ca096ab38bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 27 23:47:36 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --interface default --op new {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55715b-ae34-474e-94f7-884757acfcee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799] added\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799] added
Nov 27 23:47:36 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[1823c152-d700-4d74-91d4-0cb867d151d3]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7c2823-0023-4d97-809c-3e4539333d63]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwaYVtZU {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rwaYVtZU" returned: 0 in 0.025s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00b114-b5d6-41ba-944c-d9c16aff5586]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rwaYVtZU'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.124s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca9f878-1e92-403f-8b5c-ab20de97ac0f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aab4fc6-6860-4422-b9b3-a48d0f37e0da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:47:36 user nova-compute[75621]:  {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 27 23:47:36 user nova-compute[75621]:  {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:47:36 user nova-compute[75621]: WARNING os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 27 23:47:36 user nova-compute[75621]: 
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --login {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34044cc-580e-497b-a824-341843222c29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260]
Nov 27 23:47:36 user nova-compute[75621]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260] successful.
Nov 27 23:47:36 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.041s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d598dc-eec7-462a-8888-c8492888cca1]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[754c3ac8-903d-4eed-941e-0b820bdc27ad]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)
Nov 27 23:47:36 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)
Nov 27 23:47:36 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to 172.16.0.220:3260 {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75621) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75621) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c3cce6-eb79-49c1-a949-ae58c890dfef]: (4, ('- - 0', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75621) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 27 23:47:36 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwaYVtZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75621) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 27 23:47:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:47:37 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '23832313832336565', 'path': '/dev/sdb'} {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:47:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832313832336565', 'path': '/dev/sdb'} {{(pid=75621) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 27 23:47:37 user nova-compute[75621]: DEBUG nova.objects.instance [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:47:37 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] attach device xml: <disk type="block" device="disk">
Nov 27 23:47:37 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:47:37 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:47:37 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:47:37 user nova-compute[75621]:   <serial>ef3198ff-7761-465c-b31c-45cd66877799</serial>
Nov 27 23:47:37 user nova-compute[75621]: </disk>
Nov 27 23:47:37 user nova-compute[75621]:  {{(pid=75621) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 27 23:47:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vda, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:47:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75621) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12089}}
Nov 27 23:47:38 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] No VIF found with MAC fa:16:3e:01:e2:1b, not building metadata {{(pid=75621) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12065}}
Nov 27 23:47:38 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:38 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-b8327bf6-1384-439d-89a5-5b16195a98cd tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.976s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:47:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:47:40 user nova-compute[75621]: INFO nova.compute.manager [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Detaching volume ef3198ff-7761-465c-b31c-45cd66877799
Nov 27 23:47:40 user nova-compute[75621]: INFO nova.virt.block_device [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Attempting to driver detach volume ef3198ff-7761-465c-b31c-45cd66877799 from mountpoint /dev/vdb
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Attempting to detach device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config. {{(pid=75621) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:47:40 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:47:40 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:47:40 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:47:40 user nova-compute[75621]:   <serial>ef3198ff-7761-465c-b31c-45cd66877799</serial>
Nov 27 23:47:40 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:47:40 user nova-compute[75621]: </disk>
Nov 27 23:47:40 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:47:40 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the persistent domain config.
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config. {{(pid=75621) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.virt.libvirt.guest [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] detach device xml: <disk type="block" device="disk">
Nov 27 23:47:40 user nova-compute[75621]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 27 23:47:40 user nova-compute[75621]:   <source dev="/dev/sdb"/>
Nov 27 23:47:40 user nova-compute[75621]:   <target dev="vdb" bus="virtio"/>
Nov 27 23:47:40 user nova-compute[75621]:   <serial>ef3198ff-7761-465c-b31c-45cd66877799</serial>
Nov 27 23:47:40 user nova-compute[75621]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 27 23:47:40 user nova-compute[75621]: </disk>
Nov 27 23:47:40 user nova-compute[75621]:  {{(pid=75621) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:47:40 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:47:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:47:43 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 27 23:47:43 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] There are 0 instances to clean {{(pid=75621) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 27 23:47:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:48 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:47:55 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Cleaning up deleted instances with incomplete migration  {{(pid=75621) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:00 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:01 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b is timed out.
Nov 27 23:48:01 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully detached device vdb from instance 27c704b5-254e-454a-a8b4-c003a6f59b6b from the live domain config.
Nov 27 23:48:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] calling os-brick to detach iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f130011cb20>, {'target_iqn': 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rwaYVtZU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 27 23:48:01 user nova-compute[75621]: WARNING os_brick.initiator.connectors.base [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a34f98d-66d5-4582-a7d4-d2f0ea2e10cd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 27 23:48:01 user nova-compute[75621]: No targets found.
Nov 27 23:48:01 user nova-compute[75621]: iSNS:
Nov 27 23:48:01 user nova-compute[75621]: No targets found.
Nov 27 23:48:01 user nova-compute[75621]: STATIC:
Nov 27 23:48:01 user nova-compute[75621]: Target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799
Nov 27 23:48:01 user nova-compute[75621]:         Portal: 172.16.0.220:3260,-1
Nov 27 23:48:01 user nova-compute[75621]:                 Iface Name: default
Nov 27 23:48:01 user nova-compute[75621]: FIRMWARE:
Nov 27 23:48:01 user nova-compute[75621]: No targets found.
Nov 27 23:48:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 27 23:48:01 user nova-compute[75621]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 27 23:48:01 user nova-compute[75621]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75621) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799', 0)] {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0f74c7-bebc-4239-b4e0-fc2392e60345]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e0ee1-45ae-42f1-a2fe-789beec472c2]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)
Nov 27 23:48:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 (non-flash)
Nov 27 23:48:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f130022c430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799'): ({'sdb'}, set())}) {{(pid=75621) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Removing single pathed devices sdb {{(pid=75621) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd900f2-6575-4472-9165-630ae1910c64]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a0bf2e-b155-4919-a406-1cc88b539a44]: (4, ('ok\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Flushing IO for device /dev/sdb {{(pid=75621) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1bb88-67a2-4283-8347-d608f3d24d60]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75621) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccead836-5023-4f96-a8e4-7ae701cb0ca5]: (4, ('1', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.linuxscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] SCSI volumes sdb have been removed. {{(pid=75621) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799')] {{(pid=75621) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[85adc42d-5cab-470c-8f5b-79864d56145c]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --logout {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e12d6-e89e-4266-b1cf-c68040c7f7b3]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260]
Nov 27 23:48:01 user nova-compute[75621]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799, portal: 172.16.0.220,3260] successful.
Nov 27 23:48:01 user nova-compute[75621]:  stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op delete {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef3198ff-7761-465c-b31c-45cd66877799 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86804) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1815dc-0e48-4633-a672-777a809c562f]: (4, ('', '')) {{(pid=86804) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75621) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.base [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG os_brick.initiator.connectors.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] <== disconnect_volume: return (295ms) None {{(pid=75621) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 27 23:48:01 user nova-compute[75621]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Disconnected iSCSI Volume {{(pid=75621) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 27 23:48:02 user nova-compute[75621]: DEBUG nova.objects.instance [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'flavor' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:48:02 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-40352095-0c1e-442e-8f96-b2b27b8bafa7 tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_power_states {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Triggering sync for uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:19 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:26 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:30 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:30 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:30 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:48:32 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:32 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.processutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75621) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 27 23:48:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:48:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9044MB free_disk=24.915935516357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Instance 27c704b5-254e-454a-a8b4-c003a6f59b6b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75621) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:48:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:35 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:40 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:41 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:48:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:48:41 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquired lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Forcefully refreshing network info cache for instance {{(pid=75621) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG nova.objects.instance [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lazy-loading 'info_cache' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG nova.network.neutron [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [{"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Releasing lock "refresh_cache-27c704b5-254e-454a-a8b4-c003a6f59b6b" {{(pid=75621) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 27 23:48:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updated the network info_cache for instance {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 27 23:48:45 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:48:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:54 user nova-compute[75621]: INFO nova.compute.manager [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Terminating instance
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.compute.manager [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Start destroying the instance on the hypervisor. {{(pid=75621) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-unplugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] No waiting events found dispatching network-vif-unplugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.compute.manager [req-edfded37-5d73-4fa3-b7a7-66220cc52d8a req-7ab2bc56-b798-431a-b713-dc21171527f6 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-unplugged-3f206712-f261-4d9b-8b65-52a482d08fa6 for instance with task_state deleting. {{(pid=75621) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Instance destroyed successfully.
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.objects.instance [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lazy-loading 'resources' on Instance uuid 27c704b5-254e-454a-a8b4-c003a6f59b6b {{(pid=75621) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.virt.libvirt.vif [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-27T23:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1465678408',display_name='tempest-SnapshotDataIntegrityTests-server-1465678408',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1465678408',id=53,image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJljPfJ4wJ9esca0wkBK22HNlAnIrQGy5LL3cOI2dZEsBGsLflqXuPhqRDckOVj5qh0SuRlvSV7NZ5MagPzqG9E/zmJuQwkplZjwG3T2QX+4biNDpOPpC+ten97f9JHHBg==',key_name='tempest-keypair-1476131376',keypairs=<?>,launch_index=0,launched_at=2023-11-27T23:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb400e97b698466f9695fe9555ca52bb',ramdisk_id='',reservation_id='r-j4ayvii0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='6631148d-0ff5-48f2-bd92-4bf6df1a42c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1108010224',owner_user_name='tempest-SnapshotDataIntegrityTests-1108010224-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-27T23:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a10a98ac365349b5bf027d55faccb5ac',uuid=27c704b5-254e-454a-a8b4-c003a6f59b6b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converting VIF {"id": "3f206712-f261-4d9b-8b65-52a482d08fa6", "address": "fa:16:3e:01:e2:1b", "network": {"id": "109ff741-d490-4efd-a01d-9c58434f1571", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-986684920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb400e97b698466f9695fe9555ca52bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f206712-f2", "ovs_interfaceid": "3f206712-f261-4d9b-8b65-52a482d08fa6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG nova.network.os_vif_util [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2') {{(pid=75621) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG os_vif [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2') {{(pid=75621) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f206712-f2, bridge=br-int, if_exists=True) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d97f745-fdaa-43f8-84f0-f0bd24c17776) {{(pid=75621) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:48:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:48:54 user nova-compute[75621]: INFO os_vif [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:e2:1b,bridge_name='br-int',has_traffic_filtering=True,id=3f206712-f261-4d9b-8b65-52a482d08fa6,network=Network(109ff741-d490-4efd-a01d-9c58434f1571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f206712-f2')
Nov 27 23:48:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Deleting instance files /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b_del
Nov 27 23:48:54 user nova-compute[75621]: INFO nova.virt.libvirt.driver [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Deletion of /opt/stack/data/nova/instances/27c704b5-254e-454a-a8b4-c003a6f59b6b_del complete
Nov 27 23:48:55 user nova-compute[75621]: INFO nova.compute.manager [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 27 23:48:55 user nova-compute[75621]: DEBUG oslo.service.loopingcall [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75621) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 27 23:48:55 user nova-compute[75621]: DEBUG nova.compute.manager [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Deallocating network for instance {{(pid=75621) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 27 23:48:55 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] deallocate_for_instance() {{(pid=75621) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.network.neutron [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Updating instance_info_cache with network_info: [] {{(pid=75621) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 27 23:48:56 user nova-compute[75621]: INFO nova.compute.manager [-] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Took 1.07 seconds to deallocate network for instance.
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-99007cee-ddb6-4685-922e-c0ec483c6202 req-d2c87317-9091-4fc8-8a95-492d571ddd30 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-deleted-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.112s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:56 user nova-compute[75621]: INFO nova.scheduler.client.report [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Deleted allocations for instance 27c704b5-254e-454a-a8b4-c003a6f59b6b
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-39dde6d3-5c3f-4fd1-a6f0-7bbb3632cb2c tempest-SnapshotDataIntegrityTests-1108010224 tempest-SnapshotDataIntegrityTests-1108010224-project-member] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.273s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] Acquiring lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] Lock "27c704b5-254e-454a-a8b4-c003a6f59b6b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:48:56 user nova-compute[75621]: DEBUG nova.compute.manager [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] No waiting events found dispatching network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 {{(pid=75621) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 27 23:48:56 user nova-compute[75621]: WARNING nova.compute.manager [req-a91ebb3a-b569-4f77-b8d6-55355e2e9093 req-05a0a097-bec2-4fe6-8209-e5493a7baff4 service nova] [instance: 27c704b5-254e-454a-a8b4-c003a6f59b6b] Received unexpected event network-vif-plugged-3f206712-f261-4d9b-8b65-52a482d08fa6 for instance with vm_state deleted and task_state None.
Nov 27 23:48:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:49:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:20 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:24 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:28 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:49:32 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:49:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:49:33 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9189MB free_disk=24.943073272705078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:49:33 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:49:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:37 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:49:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:42 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:49:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:49:42 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:49:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:47 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:50 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:50 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:49:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:49:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75621) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75621) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 27 23:50:04 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:09 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:14 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:19 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:21 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:24 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:25 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:27 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:29 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:29 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:33 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:33 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75621) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager.update_available_resource {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:50:34 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Auditing locally available compute resources for user (node: user) {{(pid=75621) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 27 23:50:35 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:50:35 user nova-compute[75621]: WARNING nova.virt.libvirt.driver [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Hypervisor/Node resource view: name=user free_ram=9303MB free_disk=24.93503189086914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75621) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75621) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.compute.provider_tree [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed in ProviderTree for provider: 6c22fa5b-3db0-4974-9b71-20fe6f488e9f {{(pid=75621) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.scheduler.client.report [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Inventory has not changed for provider 6c22fa5b-3db0-4974-9b71-20fe6f488e9f based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75621) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG nova.compute.resource_tracker [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Compute_service record updated for user:user {{(pid=75621) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 27 23:50:35 user nova-compute[75621]: DEBUG oslo_concurrency.lockutils [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=75621) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 27 23:50:39 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:39 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:44 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 27 23:50:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Starting heal instance info cache {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 27 23:50:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Rebuilding the list of instances to heal {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 27 23:50:44 user nova-compute[75621]: DEBUG nova.compute.manager [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Didn't find any instances for network info cache update. {{(pid=75621) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 27 23:50:44 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:49 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:50:54 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:50:59 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:51:05 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:51:10 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 27 23:51:15 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:51:20 user nova-compute[75621]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75621) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 27 23:51:22 user nova-compute[75621]: DEBUG oslo_service.periodic_task [None req-978d1916-98d5-4876-91ff-02a33c9f363f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75621) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}